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Introduction 


Introduction 


This unit is concerned with periodic functions. A simple example is 
provided by the cosine function shown in Figure 1. 


1 cos t 


Figure 1 The cosine function cost, which has period 27 


This is a periodic function that repeats itself over every 27 interval of its 
domain. That is, if we plot the function for 0 < t < 27, and translate that 
piece of the function by +27,+47,... along the horizontal t-axis, then we 
recover the entire function. The same is true, of course, if we plot the 
function over any other domain interval of length 27. A more 
mathematical way of expressing this fact is to say that cost and 

cos(t + 27) have the same value for all t. We write 


cos(t + 27) = cos(t) for all t, 
and say that cost has period 27. 


Figures 2—4 show three more examples of periodic functions. 


1 c(t) 


= on —T 0] T 20 37 


chy 


Figure 2. The function c(t) = |cost|, with period 7 
The function c(t) shown in Figure 2 is the modulus of the cosine function, 
defined by 

c(t) = |cost]. 


This function repeats itself every domain interval of length 7. Its period 
is 7, and we write 


c(t +7) =c(t) for all t. 
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Figure 4 A sawtooth function q(t), with period 3 


The functions p(t) and q(t) shown in Figures 3 and 4 are of a type known 
as sawtooth functions because their graphs are similar in shape to the 
teeth of a saw. There are no simple one-line formulas for functions like 
this, but you will see how they can be specified in Section 1. The graph of 
p(t) in Figure 3 repeats itself over every domain interval of length 2. Its 
period is 2, and we write 


p(t +2) = p(t) for all t. 


The graph of q(t) in Figure 4 repeats itself over every domain interval of 
length 3. Its period is 3, and we write 


q(t+3) = q(t) for all t. 


Periodicity and hence periodic functions arise naturally in a wide variety of 
contexts. They may describe a regular oscillation in time or a regular 
variation in space. For the most part we will ignore the physical setting 
and just think about periodic functions of an independent variable. 


The importance of periodic functions 


A familiar example of a periodic function arises when an undamped 
pendulum or an undamped harmonic oscillator (of the type discussed 
in Unit 3) moves to and fro; in this case, the displacement is a 
periodic function of time. Many musical instruments are mechanical 
oscillators: for example, you can see the vibrating motion of the 
strings of a guitar or a piano. Other musical instruments, such as an 
organ or a flute, create oscillations of pressure in the air. 


Periodic functions are often a consequence of circular or cyclic 
motion. For example, the number of hours of daylight in London 
varies periodically with a period of one year (with a maximum 


around 21 June and a minimum around 21 December). This periodic 
variation is a consequence of the orbit of the Earth around the Sun. 
Other examples of approximately periodic functions of time, such as 
the rise and fall of the tides, can be traced to the orbits of 
astronomical bodies. (In the case of tides, the effect is predominantly 
due to the gravitational influence of the Moon.) 


Many mechanical systems naturally give rise to periodic functions of 
time. An example is the steam locomotive shown in Figure 5, where 
the periodic motion of a piston inside a cylinder drives the rotation of 
a set of wheels through a connecting rod. A very similar arrangement 
for converting the periodic motion of a piston to circular motion is 
used in almost all car engines. 


In science and engineering, we encounter periodic functions of 
position as well as time. A very important example is the 
arrangement of atoms in a crystal, where the atoms form a regular 
arrangement on a three-dimensional lattice, such as that illustrated in 
Figure 6. Here the density of electrons in the crystal is described by a 
periodic function of three spatial variables. However, this is beyond 
the scope of this unit, which considers only periodic functions of a 
single variable. 


Obviously sines and cosines are periodic functions. However, it turns out 
that (almost) all periodic functions can be written in a unified way: as a 
constant (which may be zero) plus an infinite sum over sines and cosines. 
In this way sines and cosines can be viewed as the ‘fundamental’ periodic 
functions, i.e. all others can be expressed as linear combinations of them. 


For example, it can be shown that the function c(t) = |cost| corresponds to 
the infinite sum 


ci)= ‘ [$ + 4cos(2t) — 4 cos(4t) + x cos(6t) — +++]. (1) 


This sum contains infinitely many terms. In the limiting case where all 
these terms are added together, the sum C(t) becomes equal to the 
original function c(t), allowing us to write 


c(t) = C(t). 


In a similar way, the sawtooth functions p(t) and q(t) introduced above 
correspond to the infinite sums 


Pi) = 4 [sin(mt) — 5 1 sin(3at) + a 1 sin(5at) — = sin(7mt) +--+], (2) 


Q(t) = 5 — F [eos (234) + 4 00s (284) + Fy cos (B84) + -- 
+ 2°3 fin (252) — din (492) + dysin( S$) +--+]. (3) 


When all the terms in these sums are added together, we get p(t) = P(t) 
and q(t) = Q(t). 
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Figure 5 Periodic and 
cyclical motions are often 
closely related: for example, 
periodic motion of a piston in 
a cylinder, driven by escaping 
steam, is converted to a 
circular motion of a set of 
wheels on this locomotive 


Figure 6 The atoms of 
many materials, such as this 
perovskite crystal, have a 
regular and periodic spacing; 
the electron density in such a 
crystal is a periodic function 
of position 
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Infinite sums like these are called Fourier series, named after their 
discoverer Joseph Fourier. They have a common structure, which can be 
written as 


(oe) [oe 
F(t)=Ao+ > An cos(wyt) + > By sini ti,t) 
a | n=1 
where Ap, An, By, and w, are real numbers, some of which may be equal to 
zero (details will be given in Subsection 2.1). 


Notice that we distinguish the Fourier series from its corresponding 
function by using a capital letter, so that the Fourier series for c(t) is 
denoted C(t). For all the functions that we will consider, the function f(t) 
and its Fourier series F(t) have the same values, i.e. f(t) = F(t) (except 
perhaps at isolated points), even though they may be completely different 
expressions. 


There are some interesting differences between the Fourier series in 
equations (1)—(3). C(t) is a constant plus a sum over cosines, P(t) is a sum 
over sines, and Q(t) is a constant plus a sum over both sines and cosines. 


Since sines and cosines are periodic, it is perhaps not too surprising that 
C(t), P(t) and Q(t) are also periodic. Note also that for successive terms 
in each sum, the argument of the sine or cosine increases, but the constant 
multiplying the term decreases. The sums are infinite in the sense that 
they do not stop after a finite number of terms, although in practice we 
take only enough terms to make the result as accurate as required. In this 
unit you will see how to calculate Fourier series. This means finding 
appropriate values for Ap, An, By, and w, for any given periodic function. 


To see how it is possible for a sum over sines and cosines to approach a 
given function, take a look at Figure 7. 


A 


0.4- 


0.25 


Shy 


0 02 04 06 08 1 


Figure 7 The function p(t) (in black), together with the approximations 
P,(t) (in blue) and P2(t) (in red) representing the first term and the sum 
of the first two terms in equation (2), the Fourier series for p(t) 


Here we compare the exact sawtooth function p(t) of Figure 3 with the 
first two approximations to its Fourier series P(t). The first approximation 
P,(t) is just the first term in P(t), and the second approximation P»(t) is 
the sum of the first two terms: 


P\(t) = es sin(zt), 


7 
he = 5 [sin(xt) — ¢ sin(37t) | : 


You can see that P2 (in red) is a better approximation than P, (in blue). 
More generally, as we add more terms to the Fourier series, it gradually 
approaches the original function. Each additional term improves the 
approximation. In fact, if we were to plot Pjo(t), the sum of the first 

10 terms in the Fourier series, it would be hardly distinguishable from the 
original function. Adding all the terms in the Fourier series would give 
p(t) = P(t) exactly. 


Fourier series will be used in Unit 12. There you will be looking at the 
transverse vibrations of guitar strings and the conduction of heat along 
metal rods. In the case of a vibrating guitar string, it is not surprising that 
periodic functions are involved and that Fourier series are applicable. In 
fact, by describing the shape of a displaced guitar string by a Fourier 
series, we can represent the sound made by a guitar as a sum of a 
fundamental tone and a series of harmonics. However, it is not so obvious 
that solutions to the heat conduction problem can also be found as sums of 
sinusoidal terms. This was one of the many great discoveries of Joseph 
Fourier (Figure 8). 


Study guide 


This unit shows you how to calculate the Fourier series for periodic and 
other functions, like those in equations (1)—(3). It assumes that you are 
familiar with integration by parts and complex numbers (see Unit 1). 


Section 1 defines what periodic functions are and explains how to write 
down their formulas. Much of this may be familiar to you, but we 
recommend that you read it and attempt the exercises as the ideas are 
used throughout the rest of the unit. 


Section 2 is the core section of this unit. It defines the Fourier series for a 
periodic function, and shows how such a series is calculated. It also 
explains how Fourier series can be used to represent non-periodic functions 
defined over a finite domain. Section 3 discusses the behaviour of Fourier 
series near discontinuities, and considers the differentiation of Fourier 
series. 


The remainder of the unit consists of Section 4 and an Appendix. These 
parts of the unit are optional, but we strongly advise you to study them if 
you have time, because they develop ideas that are important in more 
advanced areas of mathematics and the physical sciences. Section 4 
introduces an alternative form of the Fourier series, based on a sum of 
complex exponential functions. We illustrate the value of this form of the 
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Figure 8 The French 
mathematician, physicist and 
historian Joseph Fourier 
(1768-1830) 


Unit 11 Fourier series 


Fourier series by showing how it can help us to solve a differential 
equation. Finally, the Appendix contains proofs of formulas used in the 
main text, and also develops the important idea of orthogonal functions. 


1 Periodic functions 


Before explaining how to calculate Fourier series, we first look at the 
definition and properties of periodic functions. We then briefly review the 
types of notation that are used to express periodic functions. Finally, we 
remind you about some properties of odd and even functions. Much of this 
material may already be familiar to you, but these subsections are short 
and the material contained in them is essential to what follows. So it is 
worth reading them and trying the exercises before moving on to Section 2. 


1.1 The period of a function 


In the Introduction we looked at some examples of periodic functions, and 
stated that they have the property that, when plotted, they repeat 
themselves over some interval. We now make this intuitive notion of 
periodicity precise. 


Consider the function cost shown in Figure 9. 


1 cost 


t t+ 270 t+4r 


Figure 9 The periodicity of the cosine function: 
cost = cos(t + 27) = cos(t + 47) = cos(t + 67) =... 


Notice that cos0 = cos 27. In fact, it is clear that cost = cos(t + 27) for all 
values of t. Likewise, we can say that 


cost = cos(t + 27) = cos(t+ 47) = cos(t ++ 67) =... for all t. 
So there is an infinite set of positive values 7 = 27, 47, 67,... for which 
cost = cos(t+7) for all t. 


We call these values of 7 the periods of cost. The smallest (non-zero) 
period is 7 = 27, and this is called the fundamental period of cost. More 
generally, we make the following definitions. 


Periodic functions and their periods 


A function f(t) is said to be periodic if for some positive number T it 
satisfies 


f@)=fG+7) forall. 
The number 7 is said to be a period of the function f(t). 


If 7 is a period of f(t), then so are 27, 37, and so on. By definition, all 
periods are positive, and the smallest period of f(t) is called the 
fundamental period. 


In applications, the fundamental period is far more important than the 
other periods. For this reason, many scientists use the term period as a 
shorthand for the fundamental period. For example, the fundamental 
period of a pendulum (the time it takes to swing to and fro) is usually 
called the period of the pendulum. We occasionally use this shorthand 
when there is no risk of confusion. If we talk about the period of a 
function, then we mean its fundamental period, but if we talk of the set of 
periods of a function, then we mean all of its periods, fundamental and not. 


We sometimes need to find the period of a function such as cos(5t). In this 
case, we can argue as follows. The complete set of periods of the cosine 
function is T = 27, 47,67, 87,.... For any of these values of 7, we have 


cos(5(t + 7/5)) = cos(5t + 7) = cos(5t). 


This shows that 7/5 is one of the periods of cos(5t). The smallest such 
period corresponds to the smallest of the above values of 7, which is 27, so 
the fundamental period of cos(5t) is 27/5. More generally, the constant w 
in the functions cos(wt) and sin(wt) is called the angular frequency, and 
the fundamental period of these functions is 27/w. 


Example 1 

What are the fundamental periods of the following functions? 
(a) sin 5t 

(b) cos 3¢t 

(c) 3sin 5t + 7cos 3t 

Solution 


(a) The function sin 5t has angular frequency w = 5 and therefore has 
fundamental period 7 = 27/w = 27/5. 


(b) The function cos 3t has angular frequency w = 3 and therefore has 
fundamental period 7 = 27/w = 27/3. 


1 Periodic functions 


Unit 11 Fourier series 


10 


(c) The function 3sin 5t + 7 cos 3t is the sum of two functions: 3sin 5¢ and 
7cos 3t. The complete set of periods for 3 sin 5¢ is given by the positive 
integer multiples of 27/5, that is, 


2n An 6n 8x 107 


aS a ee eee 
The complete set of periods for 7 cos 3t is given by the positive integer 
multiples of 27/3, that is, 


2n 4n 67 8x 107 


ae ee ae eee 
The smallest period that these functions have in common is 
1072/5 = 2m for 3sin 5t and 67/3 = 27 for 7cos 3t. So the fundamental 
period of 3sin 5t + 7 cos 3¢ is 27. 


Example 2 

Find p(99) and p(99.5) for the sawtooth function p(t) in Figure 3. 
Solution 

The given function has period 2, so p(t + 2) = p(t). Hence 


p(99) = p(97) = p(95) =... = p(1) =9, 

where the final value is obtained by examination of Figure 3. Similarly, 
p(99.5) = p(97.5) = p(95.5) =... = p(1.5) = —$. 

Exercise 1 


What are the fundamental periods of the following functions? 


(a) sin (Fz) (b) cos (22) (c) sin (Fz) + 2cos (22) 


Exercise 2 


Calculate q(1000) and q(—77), where q(t) is the sawtooth function in 
Figure 4. 


1.2 Piecewise functions 


We have previously noted that the two sawtooth functions p(t) and q(t), 
sketched in Figures 3 and 4, cannot be described by simple one-line 
formulas. However, we can write down relatively simple formulas for these 
functions if we initially restrict attention to a finite interval and split this 
into two pieces. 


First consider the function p(t), whose graph is reproduced in Figure 10. 


1 Periodic functions 
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Figure 10 The function p(t) 


Notice that if ¢ lies in the interval —5 < t < 3, then p(t) =t. Also, if t lies 
in the interval 4 < t < 3, then p(t) =1—t. This allows us to use the 


pits 2° 
following notation to define p(t) on the interval —} <t < 3: 
1 1 
t for >) < t < 3 
p(t) = od 4 
1—t for 5 <t< 5: 
In this expression, we have chosen to include the point t = = in the first Different choices are equally 
region, which is written as —4 <t< 5. There is then no need to include valid. For example, the two 


— $ in the second region, so this is written as $ <t< 3. ae pees or 2 
Functions like this, which are defined on two or more pieces of their 

domain, are called piecewise functions. We now complete the definition 

of p(t) for all t by adding the information that it is periodic with period 2, 


i.e. p(t + 2) = p(t). So the full definition of p(t) is 


() t for —$ <t<3, 4) 
p(t) = 
1-t for} <t<8, 


p(t + 2) = p(t). The condition p(t + 2) = p(t) 
lies for all t. 
The first part of this definition defines p(t) on an interval of length 7 = 2. cere 


This interval is called the fundamental interval of the function. The 
second part tells us that the function has fundamental period 7 = 2. 


Note that because p(t) is periodic, it is quite permissible to define it on 
any other fundamental interval of length 2. For example, 


t for 0<t< 5, 
p(t)=(1-t forZ<t<, 
t—2 for 3<t <2, 


p(t + 2) = p(t) 


is an equally valid, if less elegant, definition. In this case the fundamental 
interval is 0 < t < 2, while in equation (4) the fundamental interval is 

1 3 
-let<3 

ZS 9: 
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Example 3 


Give a piecewise definition of the function q(t) in Figure 11, using the 
fundamental interval 0 < t < 3. 


Figure 11 The function q(t) 
Solution 


We have q(t) =t for 0 <t <1, and q(t) = 3 — $t for 1 <t <3. 
Furthermore, q(t) has period 3, so g(t + 3) = q(t) for all t. We can 
therefore define q(t) as follows: 


() t forO<t<1, 
q(t) = 
3—3t for 1<t <8, 


g(t +3) =a(t). 


Exercise 3 


Write down the piecewise definition of the function q(t) in Figure 11 over 
the fundamental interval -i <t< 3. 


Exercise 4 
Sketch the following function over the range —3 < x < 6: 
x forO <a <1, 
fia) = <1 for 1 <2 < 2, 
3—a for2?<a <3, 


f(x +3) = f(2). 


1.3 Discontinuous functions 


The function cost shown in Figure 1 is both continuous and smooth. A 
continuous function can be sketched without lifting your pen from the 
paper — there are no abrupt changes in value. A smooth function has a 
graph with no sharp corners — there are no abrupt changes in slope. The 
functions c(t), p(t) and q(t) in Figures 2—4 are all continuous, but they are 
not smooth because these graphs have sharp corners. In this subsection, 
we introduce functions that are not continuous. 
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Consider the function h(t) shown in Figure 12. 


1 h(t) 
| I I | | | 
| I I | | | 
| I I | | | 
| I I | | | 
——=6 1 o————_o—_+—_o———6 1 o—_—_—> 
—37 —27 —T 0 T 27 3r Cit 


Figure 12 A square-wave function h(t) with period 27 


This is a type of function known as a square-wave function, and the 
version considered here is defined by 


1 for —3r<t < $7, 
A(t) = 


(5) 


0 for gm <t< arr, 
h(t + 27) = h(t). 


The period of this function is 27, and the fundamental interval used in the 
above definition is $0 <t< Sr. This function is not continuous since 
h(t) has value 1 or 0 and there are abrupt changes in the function value at 
the points t = 51, an, BT, .... Such functions are said to be 
discontinuous or non-continuous. 


In Figure 12, h(t) is drawn using a convention that is sometimes used to 
specify a function at points of discontinuity. Intervals of the form 

51 <t< air are drawn with small open circles at the ends to denote the 
missing endpoints. 


We need to be a little careful about piecewise function definitions when 
dealing with discontinuous functions. Remember that functions can take 
only one value for each point in their domain. That is why we have not 
included the point t = $1 in both halves of the function definition (5). In 
the first line of this definition, we have chosen to take h = 1 at t = 51; it 
would not be consistent to assign the value h = 0 at t = 50 in the second 
line of the definition. Also, we do not define the function value 0 at t = an 
because that would contradict the first line and the property of periodicity, 
which taken together give 


h (37) =h (—47 + 2r) =h (—47) = 1 


We could equally well define a slightly different square-wave function h(t), 
taking the value 0 at the points aT, ar, BT, .... This would then be 
written as 


a(t) 1 for —37 <t < 47, 
t)= 

0 for 5m <t< ar, 
h(t + 27) = h(t), 


and drawn as shown in Figure 13. 


(6) 


1 Periodic functions 


The dashed lines are used to 
guide the eye; they are not part 
of the definition of the function. 


As noted earlier, we sometimes 
use period to mean fundamental 
period. 


This convention is used in 
mathematics, but most science 
texts do not bother with it. 


Strictly speaking, we should use 
a different symbol for this 
function, but the change is so 
minor that we do not do so. 
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1 h(t) 
| | 
| | I I 
| | I I | | 
| | I I | | 
| | | I | | 
—_— ee ee | L__ > 
—37 —27 —T 0 T 27 3r Cit 


Figure 13 A slightly different definition of h(t) 


You should check that this definition is internally consistent and does not 
attempt to give two different values at the same point. 


Discontinuities in graphs 


The real world almost always deals with continuous functions. In fact, 
discontinuous functions normally arise in science as convenient 
approximations to continuous functions. For this reason, scientists 
often take a relaxed attitude to the definitions and graphs of 
discontinuous functions, omitting the small open circles at points of 
discontinuity. We are more careful, but in the end this detail makes 
no physical difference. 


You will see that discontinuous functions have Fourier series. For example, 
it turns out that the Fourier series for h(t) is given by 


1 2 2 2 2 
H(t) = 5 + — cost — 2 cos3t + — cosdt — cost +--+. (7) 


This Fourier series applies whether h(t) is defined by equation (5) or 
equation (6). This is because Fourier series do not distinguish between 
functions that differ only at isolated points. It is quite a remarkable result 
that a discontinuous function can be written as a sum of continuous and 
smooth functions, i.e. sines and cosines. We will have more to say about 
the Fourier series for discontinuous functions in Subsection 3.1. 


Exercise 5 

Sketch the following function over —37 < t < 37: 
f@)=t for-a<t<n, 
f(t +27) = f(t). 


Exercise 6 


Consider the function u(t) shown in the figure below. 


ff 3 u(t) 
| 
| 
| 
cemee 


(a) State the positions of any discontinuities in the function, and give the 
value of its fundamental period. 


(b) Write down the piecewise definition of the function, using the 
fundamental interval —1 < t < 1. 


(c) What are the values of u(99) and u(100)? 


1.4 Even and odd functions 


In the next section we will calculate Fourier series for periodic functions. 
In addition to being periodic, some of these functions will be even or odd, 
and this can simplify the calculations. It is therefore useful to review some 
properties of even and odd functions that were discussed in Unit 1. Recall 
that even and odd functions are defined as follows. 


Definitions 
A function f(t) is said to be even if f(—t) = f(t) for all t. 
A function f(t) is said to be odd if f(—t) = —f(t) for all t. 


Typical examples of even functions are 1, x”, 2x? + 4a*, cosx and exp(z”). 
Typical examples of odd functions are 2, 2 + 42°, sina and x exp(z?). 


It is easy to recognise even and odd functions from their graphs. An even 
function, such as that shown in Figure 14, takes the same values at 
corresponding points on either side of the vertical axis, so its graph 
remains unchanged when it is reflected in the vertical axis. 


By contrast an odd function, such as that shown in Figure 15, has values 
of the same magnitude but opposite signs at corresponding points on 
either side of the vertical axis, so its graph changes sign when it is reflected 
in the vertical axis. 


Returning to the functions considered at the beginning of the Introduction, 
we see that those in Figures 1 and 2 are even, while that in Figure 3 is 
odd. The function in Figure 4 is neither even nor odd. 


When we calculate Fourier series, we will need to evaluate definite 
integrals. It is useful to note that simplifications occur when even and odd 
functions are integrated over a range that is symmetric about the origin. 


Recall that if f(t) is an odd function, then 


a 
sii =. 
—-a 
The reason, illustrated in Figure 16, is that the area under f(t) between 
—a and 0 (in yellow) has the same magnitude but opposite sign to the area 
between 0 and a (in blue). So the total area between —a and a vanishes. 


1 Periodic functions 


Most functions are neither even 
nor odd. 


0 t 


Figure 14 An even function 


A 


f(t) 


Figure 15 An odd function 


Figure 16 The integral of an 
odd function f(t) over a 
range from —a to a 
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Figure 17 The integral of an 
even function f(t) over a 
range from —a to a 
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Now consider the integral of an even function f(t) between —a and a, as 
illustrated in Figure 17. Clearly the area under the function between —a 
and a is just twice that between 0 and a. This means that 


rea=2 fl peat 


for any even function f(t). 


We collect these results for later use. 


Integrals of odd and even functions over symmetric ranges 
If f(x) is an odd function, then 


OO. (8) 


=@ 


If f(x) is an even function, then 


f sjar=2 [sede (9) 


Example 4 
Calculate the value of 
1 
i= / sin(x?) cos(x?) dz. 
=i 
Solution 
The integrand is f(a) = sin(x*) cos(x?). This is odd because 
f(-a) = sin((~2)8) eos((—2)?) 
sin(—2?) cos(x) 
= —sin(x°) cos(x”) = —f(z). 


The range of integration is symmetric about the origin, so 


1 
l= | sin(x?) cos(x) dx = 0. 


-1 


In general, the product of an odd function and an even function is odd, and 
the product of two odd functions or two even functions is even. Also, the 
sum of two odd functions is odd, and the sum of two even functions is even. 


Exercise 7 

Determine whether the following functions are even, odd or neither. 
(a) 23 — 3x (b) 2sinz + 3sin(4z) (c) 5+2cosz + 7cos(4z) 
(d) 4—2sinz (e) 2x cos(3z) 


Exercise 8 


Calculate the values of the following definite integrals. 


1 2 
(a) / ax? cos(2x) dx (b) [fe + sin(2x°)) dx 


il 


2 Introducing Fourier series 


This section contains the core material of this unit. It defines what is 
meant by a Fourier series and shows you the basic method for calculating 
the Fourier series for any periodic function. The process of finding the 
Fourier series for a function is given in Procedure 1. The three examples 
that follow apply this procedure to specific periodic functions. 

Subsection 2.2 shows how this procedure can be simplified if the periodic 
function is either even or odd. Finally, Subsection 2.3 shows how Fourier 
series can be calculated for non-periodic functions that are defined over a 
finite domain. 


2.1 Fourier series for periodic functions 


Suppose that we have a periodic function f(t) with fundamental period r. 
Then we define its Fourier series to have the form 


2rt Art +t 
F(t) = Ao + (Arcos (7 *) 4 Ag cos (= *) 4 Ayoos (=) +...) 
T i T 
nt Ant 
+ (Basin (7 *) 4 Basin (=) 4 Basin (=) +.) 
T 


where the sums may continue forever. More concisely, the Fourier series 
can be written as 


F(t) = Aes As cos (**7") eS aan (==). (10) 


n=1 n=l 
or as 
fore) [oe 
F(t) = Ag + >, An COS (Wyt) + », By sin (wnt) , (11) 
n=1 n=1 
where 
2n0t 
Wyn =— (n=1,2,3,...). 
- 


Each periodic function f(t) of fundamental period 7 has its own Fourier 
series F'(t), characterised by a particular set of constants Ap, An, Bn 
(n = 1,2,3,...). These are called the Fourier coefficients for f(t). 
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Finding the Fourier series for a function means finding its Fourier 
coefficients Ap, An, By, for n = 1,2,3,.... 


As stated in the Introduction, a periodic function f(t) and its Fourier 
series F(t) are the same function, i.e. f(t) = F(t) (except perhaps at 
isolated points), even though their formulas look quite different. 


Since f(t) has period 7, we know that f(t+ 7) = f(t) for all t. Let us check 
that this property is also true for the Fourier series F(t). We can do this 
by noting that cos(wt) and sin(wt) have angular frequency w and 
fundamental period 7 = 27/w. Similarly, cos(w,t) and sin(w,,t) have 
angular frequency w, and fundamental period 27/w, = T/n. Other periods 
of these functions are obtained by multiplying 7/n by any positive integer, 
so T is one of the periods of cos(w,t) and sin(w,t). Since every term in the 
Fourier series of equation (11) has 7 as one of its periods, we conclude that 


F(t+7) =Fi(t) for allt, 
as required. 


To illustrate the meaning of equations (10) and (11), let us return to the 
examples given in the Introduction. The function c(t) = |cos ¢], illustrated 
in Figure 2, has fundamental period tT = 7, so wy, = 2na/m = 2n. We 
therefore expect this function to have a Fourier series of the form 


co co 
C(t) = Ap + > A, cos(2nt) + > By, sin(2nt). 
n=1 n=1 
However, the Introduction stated that the Fourier series for c(t) is given by 
equation (1). You can see that these two equations are equivalent if the 
Fourier coefficients for c(t) are given by 


2 4 4 4 
ie Be AH =. te 
0 ; 1 3 ) 2 15 ’ 3 357° , 
with By = Bo = Bg sao = 0; 
Exercise 9 


Deduce the Fourier coefficients Ag, Ai, A2, A3, Ag and By, Bo, B3, By for 
the sawtooth function p(t) in Figure 3, whose Fourier series is given by 
equation (2). 


The key question, of course, is how do you deduce the Fourier coefficients 
for a general periodic function f(t)? To begin to answer this question, let 
us suppose that a function f(t) with fundamental period 7 has Fourier 
series F(t). The function and its Fourier series are supposed to have 
identical values, so we can write equation (10) as 


= 2niat = . 2ni1t 
f(t) = Ao + 2 An cos (==) + 2, Bn sin (==) ‘ (12) 


2 Introducing Fourier series 


We can get some useful information by integrating both sides of this 
equation with respect to t over a complete period of f(t), from t = —7/2 to 
L=9/2. 


The expression on the right-hand side of equation (12) is a sum of terms, 
and its integral is found by integrating these terms one by one. In other 
words, we assume that the summation and integral signs can be 
interchanged, giving 


7/2 7/2 co 7/2 
fod= Ao dt + S- An / cos (==) dt 
—1/2 —71/2 w=1 —1/2 T 
oo 7/2 
si Ss" Bn | sin (==) dt. (13) 
n=1 —7/2 “ 


We can immediately see that the integrals of all the sine terms vanish. 
This is because sin(2nat/7) is an odd function of t, and the range of 
integration is symmetric about the origin. 


The integrals of the cosine terms also vanish, but for a different reason. In 
this case, we have 


ie & [ jt 
cos | —— }] dt = |—— sin 
—1/2 i 2n0 ir —1/2 


T : : 
= — (sin(n7) — sin(—n7)), For any integer m, sin(m7) = 


2nt 
and this is equal to zero for n = 1,2,3,.... 


The only term that survives on the right-hand side of equation (13) is the 

integral of Ag, which is given by 

72 7/2 

Ag dt = [ Aot] —1/2 _ Aor. 
—1/2 

We therefore conclude that 


1 7/2 
Ap = - | f(t) dt. (14) 
T J—1/2 
The coefficient Ap in the Fourier series is therefore found by integrating 
f(t) over its fundamental interval: this integral is the average value of f(t). 


Example 5 


Use equation (14) to calculate the Fourier coefficient Ao for the function 
h(t) shown in Figure 13. 


Solution 


From Figure 13, it is clear that h(t) has period 7 = 27. Hence using 
equation (14) we have 


ey ea at 
i a as 


0. 
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This integral represents the area under the graph of h(t) between —7 
and 7. An examination of the figure shows that this is equal to 7. Hence 


‘ll 
Ao = 5; 


in agreement with the stated Fourier series in equation (7). 


Exercise 10 


Use equation (14) to calculate the Fourier coefficient Ao for the function 
c(t) = |cost| shown in Figure 2. 


The above calculation of Ag relies on the fact that the integrals of sines 
and cosines appearing in equation (13) are all equal to zero. Without 
doing any calculations, you can get an idea of why this happens. It is 
because the sine and cosine functions in equation (13) oscillate, taking 
both positive and negative values. The integral from t = —7/2 to t = 7/2 
takes us over a whole number of periods of cos(2nzt/r) or sin(2nzt/r), and 
over any such range, the positive and negative contributions cancel, giving 
zero integrals. An example of this (with n = 2) is shown in Figure 18. 


Figure 18 A graph of cos(4zt/7) from —7/2 to 7/2 


So far, we have found just one of the Fourier coefficients. The remaining 
coefficients can also be found by a process of integration. We will soon give 
formulas for them, and concentrate on the main task of calculating Fourier 
series for particular functions. The derivation of these formulas is given in 
the optional Appendix, but we give a sketch of the argument here, 
skimming over the fine details. 


Suppose that we want to find the coefficient Ag. We note that the cosine 
that accompanies Ag in the Fourier series is cos(4at/r). The trick is then 


to multiply both sides of equation (12) by cos(4zt/r) before integrating 
over t from —7/2 to 7/2. This gives a modified version of equation (13), 
but with an extra factor cos(4zt/r) inside each integral. 


Now cosines are always even functions, so cos(4zt/7) sin(2nzt/r) is an odd 
function. It follows that 


7/2 
Bn | cos (=) sin (==) dt = 0. 
—1/2 T T 


We also have 


Ay | cos (=) dt = 0, 
—71/2 T 


for the reasons outlined above — we are integrating an oscillating cosine 
function over a complete number of its periods, so the positive and 
negative contributions to the integral cancel. Hence our modified version of 
equation (13) simplifies to 


i Ant = pe Ant Qnmt 
f(t) cos (=) d= > An f cos (=) cos (=) dt. (15) 
—1/2 T AHA —7/2 T T 
The integrals on the right-hand side can be evaluated by using the 
trigonometric identity cos Acos B = $[cos(A + B) + cos(A — B)}, which 


converts a product of two cosines into a sum of two cosines. We can use 
this identity to write 


ccsaad cen (@=208)) a9 


We need to integrate this from t = —7/2 to t = 7/2. Because n is an 
integer, we are integrating cosine functions over a whole number of their 
periods. As you have seen before, this means that the positive and 
negative contributions cancel, giving an integral that is equal to zero. This 
argument applies to almost every term on the right-hand side of 

equation (15), with just one exception. When n = 2, we have 4 — 2n = 0 
and one of the cosines in equation (16) is cos0 = 1. We therefore see that 
equation (15) reduces to 


4 7/2 
f(t) cos (=) dt = Aa | 1 dt = = Aa, 


—71/2 


7/2 
—1/2 
which can be rearranged to give a formula for Ao: 


ea ia Ant 
Ag = - f(t) cos (=) dt. 


T —7/2 
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With more work this method can be extended, providing us with formulas 
for all the Fourier coefficients. The complete set of these formulas is 


7/2 
ye / f(t) dt, 


T —71/2 
7/2 
figet F(t) cos (=) at (n = 1,2,3,...), 
ae —71/2 T 
7/2 
Ba= =f" sesin(™) at (n=1,2,3,...) 
T —7/2 


Of course, we have only sketched the derivation of these results (further 
details can be found in the Appendix), but the really important thing is 
that these formulas exist and allow us to calculate the Fourier series for 
any periodic function f(t). 


Procedure 1 Fourier series for periodic functions 


To find the Fourier series for a periodic function f(t), proceed as 
follows. 


1. Find the fundamental period rT. 


2. Write down the Fourier series 


F(t) = a+ Anos (2 Tt) +3 Basin (= *). (17) 


i? 


where Ap and the A, and B,, are coefficients to be determined. 
Simplify the arguments of the sines and cosines where possible. 


3. Use the following formulas to determine the Fourier coefficients: 


it 7/2 

he i f(t) dt, (18) 
ce —7/2 
») 7/2 ») 

ees f(t) cos (==) ee @eI2o.0) (19) 
ce —71/2 T 

a2 

B= =f sesin(™) ae (n= 1,28... C0) 

off aff) i 


4. If desired, express the final Fourier series in a compact form with 
general formulas for its coefficients. 


Because the Fourier series in equation (17) involves sines and cosines, we 
sometimes refer to it as the trigonometric Fourier series. This allows 
us distinguish it from the exponential Fourier series, which is discussed at 
the end of the unit. It is worth noting that the formula for Ap contains the 
factor 1/7, while the formulas for A, and B, contain the factor 2/r. 


Examples 6-8 below illustrate how to calculate the Fourier series for any 
periodic function. Sometimes the algebra gets a little tedious, and it is 


important to work with care and patience, but if you persevere you will 
have understood the main idea of this unit. Later we will show you some 
tricks that can simplify the calculations. In the last step of the procedure, 
the following values are often helpful. 


Some useful values 


If n is any integer, then we have 


cos(nm) = (—1)", (21) 
sin(n7) = 0, (22) 
nt (—1)"/2 for n even, 
= 23 
cos ( nl tr for n odd, ce 
_ ont 0 for n even, 
oy ce 7 (Ses? for n odd. 7 


Example 6 
Use Procedure 1 to find the Fourier series for the square-wave function 
=1 for—% <i <0, 
i tor Ofte 4, 
f+) = f(é), 
sketched in Figure 19. 


i= 


Figure 19 A particular type of square-wave function 


Solution 


The function f(t) is odd and has fundamental period 7 = 7. From 
equation (17), its Fourier series has the form 


F(t) = Ao + a A, cos(2nt) + > By, sin(2nt), (25) 


n=l n=1 


where Ag, A, and B, (n = 1,2,3,...) need to be determined. 
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We now calculate these Fourier coefficients. From equation (18) we get 


a/2 
As= - | f(t) dt. 


WT J—n/2 


However, f(t) is an odd function, and we know that the integral of an odd 
function over a range that is symmetric about the origin is equal to zero. 


Hence 
Ap = 0. 
Using equation (19) we get 
2 a/2 
An = - | f (t) cos(2nt) dt. 
T J—n/2 


Again, f(t) cos(2nt) is an odd function of t because f(t) is odd and 
cos(2nt) is even, so 


An =0 for alln = 1,2,3,.... 


Finally, from equation (20) we get 
n/2 


By = - | f(t) sin(2nt) dt. 


T J—7/2 


Since both f(t) and sin(2nt) are odd, f(t) sin(2nt) is even, so using 
equation (9) we have 


n/2 
By = - | f (t) sin(2nt) dt. 


But f(t) =1 for 0 <t < 1/2, so 
n/2 


4 r/2 4 1 2 
Bn = = | sin(2nt) dt = = 5 cos(2n) = — 7 (cos(nm) - 


0 


where we have used cos0 = 1. Also, from equation (21) we have 
cos(nm) = (—1)”", so 


Substituting the values for Ag, A, and B, into equation (25) gives 


F(t) = > =(1 - (-1)") sin(2nt), 


n=1 


This is the Fourier series for the function f(t) given in the question. 


1), 


(26) 


The first few non-zero terms of the Fourier series in equation (26) look like 


F(t) = “(1 (a) Yemtoeye =A — (-1)?) sin(4t) 
+ =(1 — (—1)°) sin(6t) + --- 


4 4 4 
= sin(2t) + a sin(6t) + Bx sin(10t) +---. 


To see how many terms are needed to get a good approximation to the 
original function f(t), let us take the truncated Fourier series F(t) to 
be the sum of the first N terms of the Fourier series. In this case, 


= = = 1 — (—1)") sin(2nt). 


We would expect F(t) to get closer and closer to f(t) as N increases. 
This is borne out by Figure 20, which compares F(t) (in blue) and F9(t) 
(in red) with the original function f(t) (in black). 


Figure 20 The square-wave function f (in black) together with its 
truncated Fourier series approximations Fs (in blue) and Fp (in red) 


In general, as the number of terms N increases, the truncated Fourier 
series F'y(t) approaches the original function f(t). 


Fourier series can sometimes be written in alternative forms. Returning to 
equation (26), for example, we may notice that 1 — (—1)" = 0 when n is 
even, and 1 — (—1)" = 2 when n is odd. Hence the only values of n that 
contribute to this Fourier series are n = 1,3,5,.... These values of n are 
given by n = 2m —1 for m = 1,2,3,..., so the Fourier series also can be 
expressed as 

[oe) 


at Dear: oa sin(2(2m — 1)t). (27) 


Equations (26) and (27) are fully equivalent, and it doesn’t matter which 
we use: both are the Fourier series for the function f(t). 


Let us pause for a moment to review what has been achieved. We assumed 
that the function f(t) sketched in Figure 19 can be represented as a 
Fourier series of the form 


F(t) = Ag+ » Ap cos(2nt) + Ss B,, sin(2nt). 


n=1 n=1 
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26 


This means that f(t) is equal to F(t), except possibly at isolated points, so 
almost everywhere we can write 


[oe] (oe) 
f(t) = Ao + S— An cos(2nt) + 5” B, sin(2nt), (28) 
n=1 n=1 
where Ap, A, and B, for n = 1,2,3,... are constants that are initially 
unknown. The major task of finding these constants was carried out using 
equations (18)—(20). For example, 


Ay =— [- f@yoos(Qnt)dt (a= 1,2,3,.); (29) 


T J—n/2 


A deep analogy 


The task of finding Fourier coefficients has much in common with the 
task of finding vector components. Suppose that we are given a vector 
v in three-dimensional space. We may know the magnitude and 
direction of this vector, but not its components. Nevertheless, we can 
write 


= Ulla yd Fe Oy, (30) 


where vz, Vy and vz are constants that are initially unknown, and i, j 
and k are Cartesian unit vectors. The problem of finding the 
constants is solved by taking scalar products with the unit vectors, 
giving 

Up — toe Uy, — Va Uy — ee (31) 


Equations (28) and (30) are analogous because their right-hand sides 
are sums involving initially unknown constants. And equations (29) 
and (31) are analogous because they allow us to isolate individual 
constants from the sums. Most analogies are weak, and evaporate 
when we look at them in more detail. However, this analogy turns out 
to be deep and strong. Indeed, mathematicians often think of Fourier 
coefficients as being something like the components of vectors, and 
use language that further cements this kinship. More details of this 
fascinating viewpoint are given in the Appendix. 


The most time-consuming task in calculating Fourier series is usually the 
evaluation of the integrals. In practice, scientists often use tables of 
integrals or computer algebra programs, and in this text we will give some 
standard integrals that can be used as shortcuts. The two results given 
below are often useful. 


Two useful integrals 


[ tsin(at) i = (sin(at) — at cos(at)), (32) 
/ feos(ande = = (cos(at) Laneimict)). (33) 


Example 7 


Find the Fourier series for the sawtooth function 
—t for -1<t<0, 
f(t) = 
t for0O<t<1l, 
f(é+ 2) = f), 
sketched in Figure 21. 


Figure 21 A sawtooth function 


Solution 


The function f is even and has fundamental period 7 = 2. Using 
equation (17), its Fourier series has the form 


F(t) = Ag+ > A, cos(nat) + > B, sin(nat), 


n=1 n=1 
where Ag, A, and B, (for n = 1,2,3,...) are the Fourier coefficients. 


From equation (18) we get 


1 i 
Ag = sf. f(t) dt. 


Since f is even, we can use equation (9) to write 


1 
Ao= | f(t) dt. 


However, f(t) =t for 0 <t <1, hence 


. 1 
Ao = tdt = [5t7], = 4. 
0 


2 Introducing Fourier series 


These results can be derived 
using integration by parts. 
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We use a similar method to calculate the A,: 
2 fl 
Ay = a f(t) cos(nzt) dt 
-1 
1 
= 2 | f (t) cos(nat) dt 
0 
1 
= 2 | tcos(nrt) dt. 
0 


Using the standard integral in equation (33), we get 
2 
An = Can [cos(nat) + nat sin(nat)] 5 
__? ( 
~ Trap 
But cos(n7) = (—1)” and sin(nz) = 0 for any integer n. So 
2 


Tame 0" —1) (n=1,2,3,...). 


cos(nm) + nmsin(nm) — 1). 


n= 


The B, are given by 


1 
By = I. f(t) sin(nzt) dt 


However, sin(nzt) is an odd function of t, and f(t) is an even function of t, 
so the integrand f(t) sin(nzt) is an odd function of t. From Subsection 1.4 
we know that the integral of an odd function over a range that is 
symmetric about the origin vanishes, so 


Bn =0 (n=1,2,3,...). 


Hence the Fourier series for f(t) is given by 


tw 
Ohare 


— 1)cos(nzt). (34) 


The first few terms in equation (34) look like 


1 4 4 
ae) a2 cos(37t) — 5E7 
To investigate how rapidly the right-hand side of this equation approaches 
the original function f(t) as we add more and more terms, we introduce 
the truncated Fourier series F'y(t) defined by 


FG) = cos(mt) — cos(5at) — 


1 
ig ~ ee Cae — 1)cos(nat). 


Figure 22 compares F3 (in blue) and Fs (in red) with the original 
function f. We see that Fs is already a very good approximation to f. 


t 


Figure 22 The sawtooth function f (in black) together with its truncated 
Fourier series approximations F3 (in blue) and Fs (in red) 


It is also possible to express the Fourier series in a slightly different way. 
Noting that the non-zero terms in equation (34) occur only for odd values 
of n (i.e. for the values n = 2m — 1 with m = 1,2,3,...), we can write the 
Fourier series as 


F(t) = 5 > Sn or coat oni al); (35) 


and this is entirely equivalent to equation (34). 


Example 8 


Find the Fourier series for the function 


0 for-1<t<0O, 
t) = 
P(e) . tor 0a 


f(t +2) = fl), 


sketched in Figure 23. 


Figure 23 Graph of a function f(t) that is neither even nor odd 


Solution 


The function f(t) is neither even nor odd, and is discontinuous. It has 
fundamental period 7 = 2. So, using equation (17), its Fourier series takes 
the form 


F(t) = Ao + > An cos(nat) + S- By sin(nat), 


n=1 n=1 


where the coefficients Ag, A, and B,, (n = 1,2,3,...) are to be determined. 
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From equation (18) we get 


1 i 
Ag = 5 ff dt. 


To integrate a function defined on pieces, we simply integrate each piece in 
turn using the correct value of the function on each piece. So 


A -if peoart f peyaa} fra ey =3 
oo =i 2 0 7) 0 ~ la O04? 


where we have used the fact that f(t) =0 for -1<t<0 and f(t) =t for 
O<t<l. 


Equation (19) gives 
9 pl 
An=5 fi flcos(nat)dt (n=1,2,3,..). 
= 


Again, to integrate a function defined on pieces, we simply integrate on 
each piece in turn using the correct value of the function on each piece. 
This gives 


0 1 
Ay = i f(t) cos(nzt) a+ | f(t) cos(nzt) dt 


i 
=i tcos(nat) dt. 
0 


Using the standard integral given in equation (33), we get 


1 
An = (an? [cos(nat) + nat sin(nrt)] 5 
1 
= (an (cos(nm) + nm sin(nm) — 1). 
These values are given in But cos(n7) = (—1)” and sin(nz) = 0 for any integer n. So 
equations (21) and (22). 1 


An = Gap(-" 1) (W=1,2,3,..), 


The B,, are found using equation (20): 
1 
By = / f(t) sin(nat) dt 
-1 
0 1 
= / f(t) sin(nat) dt + [ f(t) sin(nat) dt 
| 0 
1 
- fl tsin(nat) dt. 
0 


Now use the standard integral in equation (32). This gives 


By = [sin(nat) — nat cos(nmt)] 5 


(na)? 
1 


= Cine (sin(na) — nm cos(nm)). 
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2 Introducing Fourier series 


Since sin(n7) = 0 and cos(n7) = (—1)” for any integer n, we get 


el 


NT 


Bn, =— (n = 1,2,3,...). 


Putting all these results together, the required Fourier series is 
[oe] 
(=1" 
if PY 
) cos(nzt) » a 


n=1 


sin(nat). 


To see how the right-hand side of this equation for F(t) approaches the 
original function f(t) as we add more and more terms, we once again 
consider a truncated Fourier series: Other definitions could be given 


1 1 N for Fy, but this makes no 
Fy(t) = ri + ‘Ss 5 ((—1)" — 1) cos(nzt) oS 
n= n=1 


difference to our general 
argument. 

In Figure 24 we compare Fy (in blue) and F9 (in red) with the original 

function f (in black). 


Ne 


sin(nat). 


A 


Figure 24 The function f (in black) together with the truncated Fourier 
series approximations Fs; (in blue) and F'%9 (in red) 


Notice that in this case, we need to take N = 20 or more to get a 
reasonable approximation to this function at most points in its domain. 

A similar observation was made for the square-wave function in 

Example 6. However, the Fourier series for the continuous function 
discussed in Example 7 showed quite different behaviour; in that case a 
truncated Fourier series /’3 with only four terms is already a good 
approximation to the original function. In general, fewer terms of a Fourier 
series are needed to approximate a continuous function than a 
discontinuous one. We say that the Fourier series for a continuous function 
converges more rapidly than the Fourier series for a discontinuous 
function. We will return to this point in Subsection 3.1. 
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Figure 25 The first 
commercial Moog synthesiser 
(1964) 


Although it can be tedious, aim 
to be patient and careful when 
evaluating the integrals needed 
in Fourier series! 
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Fourier series and musical sounds 


You can actually hear the difference between different Fourier series! 
A musical note corresponds to a rapid oscillation in the pressure of 
air, with a given fundamental period 7, and a corresponding 
fundamental angular frequency w = 27/r. For example, middle C has 
a fundamental period of about 3.82 milliseconds. All musical 
instruments playing this note produce pressure variations that are 
periodic functions of time with this fundamental period. But the 
precise shapes of these periodic functions are different when produced 
by a piano, a guitar or a violin, and the corresponding Fourier series 
are different too. 


The Fourier series for a musical note is a sum of sinusoidal functions 
with frequencies that are harmonics, that is, integer multiples of the 
fundamental angular frequency of the musical tone. The greater the 
contribution from the harmonics, the ‘brighter’ the tone of the 
musical instrument. For example, a violin produces a brighter tone 
than a guitar because the oscillation has a greater contribution from 
high harmonics of the fundamental frequency. The periodic function 
in Figure 24 contains harmonics that die away slowly as n increases. 
If this function represented a musical note of middle C, the effect 
would be unpleasantly rasping. 


What can be analysed can also be synthesised. Figure 25 shows a 
Moog synthesiser, which was used in 1960s and 1970s pop music to 
construct complex musical tones from linear combinations of 
sinusoidal oscillations (Fourier series, in fact!). 


Exercise 11 


Find the Fourier series for the function 


f@)=t for -a<t<rn, 
f(t-+2n) = f(t). 


Exercise 12 


Find the Fourier series for the function 


z+1 for-l<a2<0, 
f(z) = 
1 for0 <a <1, 


fle +2) = f(z). 


2.2 Fourier series for odd and even functions 


Examples 6-8 in the previous subsection displayed three different types of 
behaviour. In Example 6, the function was odd and the Fourier series 
contained only sine terms. In Example 7, the function was even and the 
Fourier series contained only constant and cosine terms. Finally, in 
Example 8, the function was neither odd nor even and its Fourier series 
contained constant, cosine and sine terms. 


This pattern is easily explained. If the function f(t) is odd, the integrals 
for Ag and A,, in equations (18) and (19) involve odd integrands integrated 
over a range that is symmetric about the origin: such integrals are equal to 
zero, leaving only sine terms in the Fourier series. Similarly, if the function 
f(t) is even, the integrals for B, in equation (20) involve odd integrands 
integrated over a range that is symmetric about the origin: these integrals 
vanish, leaving only constant and cosine terms in the Fourier series. 
Taking note of these facts, the procedure for calculating the Fourier series 
for a function f(t) can be simplified if f(t) is either odd or even. 


If f(t) is an odd periodic function, with fundamental period 7, then all the 
Fourier coefficients Ag and A, vanish, and using equations (9) and (20), 
the integral for the B, coefficients can be simplified slightly: 


7/2 7/2 Onrt 
By = : f(t) sin (==) dt= -[ f(t) sin (7) dt. 
T —1/2 T T Jo E 


The second integral is often a little easier to evaluate than the first, but 
both lead to the same result. 


Procedure 2 Fourier series for odd periodic functions 


To find the Fourier series for an odd periodic function f(t), proceed 
as follows. 


1. Identify f(t) as being odd, and find its fundamental period r. 


2. Write down the Fourier series 


F(t) = y pean (==) (36) 


3. Find the coefficients by evaluating the definite integrals 
Ae fe Qnat 
P= = | f(t) sin (==) HE (G0 (37) 
F INO i: 


4. If desired, express the final Fourier series in a compact form with 
general formulas for its coefficients. 


A similar simplification occurs for even functions. In this case, the B, 
coefficients vanish. Also, the integrands for Aj and A, are even, so these 
coefficients can be expressed as integrals from 0 to 7/2. 
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Procedure 3 Fourier series for even periodic functions 


To find the Fourier series for an even periodic function f(t), proceed 
as follows. 
1. Identify f(t) as being even, and find its fundamental period r. 


2. Write down the Fourier series 


vale tig Se Axes (==) (38) 


w—1 


3. Find the coefficients by evaluating the definite integrals 


D) aip2 
Ag = = i f(t) dt, (39) 


2n1t 


ae ££ 50 B08 (==) esc) (40) 


T 


4. If desired, express the final Fourier series in a compact form with 
general formulas for its coefficients. 


To take advantage of the oddness and evenness of functions, we must take 
the fundamental interval to be symmetric about the origin, from —7/2 to 
7/2. However, a piecewise continuous periodic function may be given on 
some other fundamental interval. For example, the function h(t) in 
Exercise 14 below is defined on $9 <t< ar, with a periodicity condition 
that gives the values of the function elsewhere. In cases like this, it is 
advisable to sketch a graph of the function — partly to check that it is odd 
or even, and partly to get the values that are needed in the range 
—7T/2<t<7/2. 


Example 9 
Use Procedure 2 to find the Fourier series for the sawtooth function 
2 oid 1 
t for >) < t < 5 
p(t) = i . 
1—t for 5 t= > 
p(t + 2) = p(t). 


This function was sketched in Figure 3, which is reproduced in Figure 26. 


HY 


Figure 26 A sawtooth function 


Solution 


It is clear from Figure 26 that p(t) is an odd function with fundamental 
period 7 = 2. Following Procedure 2, its Fourier series contains only sine 
terms and takes the form 


Pi) = > B, sin(nat). 
n=l 


The Fourier coefficients are given by 


4 


1 
5, = a p(t) sin(nat) dt. 
2 Jo 


Within this range of integration, p(t) =t for 0 <t < 1/2, and p(t) =1-t 
for 1/2 <t <1. So the integral splits into two pieces: 


1/2 1 
By = 2 | tsin(nat) dt + 2 | (1 — t) sin(nzt) dt. 
0 1/2 
Using the standard integral in equation (32), we obtain 


2 
[sin (nat) — nat cos(nat)] ./? + — [- cos(nmt) | is 
nt 


_ 2 
(nm)? 
pgs 
(nm)? 


Substituting in the limits, we get 
2 . (nt nt nT 
Po Cae (sin (>) - Feos(F)) 
2 nt 
+ — (- cos(nm) + cos (=)) 
nt yi 
nt nt 


= a (sin(nm) — nm cos(n7m) — sin (=) + > 008 (=)) . 


Carefully combining terms, making cancellations, and using sin(n7) = 0, 
this gives 


4 _ (nt 
Ba = (nm)? sin (>) . 
The required Fourier series is therefore 
41 
Pi) = 5 d 72 sin (=) sin(nt). 


For n = 1,2,3,4,5,6, 7, the values of sin(n7z/2) are 1,0,—1,0,1,0,—1, so 
the first few terms in the Fourier series are 


[sin(nat) — nat cos(nat)| ie 


4 
P(t) = — (sin(at) — § sin(3mt) + oe sin(5rt) — 7g sin(7mt) +--+), 
T 


as stated in equation (2) of the Introduction. 
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This function was discussed in 
Example 7, but the present 
calculation is more efficient. 
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Only the odd values of n contribute to the Fourier series. Putting 
n = 2m-— 1 and noting that equation (24) gives 
sin((2m — 1)r/2) = (—1)™*?, this Fourier series can also be written in the 
alternative form 
fe (1. 
Pi) = =) a (am 12 sin((2m — 1)zt). 


Exercise 13 


Use Procedure 3 to find the Fourier series for the sawtooth function 


—t for -1<t<0, 
fO= 
t forO<t<1l, 


f(E+2) = Ff), 
sketched in the figure below. 


Exercise 14 


Find the Fourier series for the square-wave function defined in equation (5) 
by 


1 for —3r<t< 
ha) = ; ; 
Q tor-,7 <b on, 


Nie 


T, 


h(t + 27) = h(t). 


Exercise 15 

Find the Fourier series for the function c(t) defined in the Introduction as 
c(t) = |cost|, 

and sketched in Figure 2. 


You may use the standard integral 


[ contat sting = bcos(at) nh - cost) sin(at) Cea 


2.3 Functions defined over a finite domain 


So far you have seen how to calculate the Fourier series for any periodic 
function. However, this is not the whole story. It is also possible to 
calculate the Fourier series for (almost) any function, provided that it is 
defined over a finite domain. This idea will be particularly useful in the 
next unit. 


Suppose that a function f(t) is defined within the finite interval 0 < t < T 
of length T (see Figure 27). Furthermore, suppose that we do not care 
about what happens to the function outside this interval. 


f(t) 


0 T i 
Figure 27 A function f(t) defined on a finite interval 0 < t < T 


Then we can always define another function fext(t) to be equal to f(t) on 
the interval 0 < t < 7, and to be periodic with fundamental period T 
everywhere else. This function is called a periodic extension of f(t) and 
is written as 

PHioeaSTQ) teria ee7, 

faxtt aie T) = rae 
The graph of fext(t) consists of copies of f(t) shifted by T and by all 
positive and negative integer multiples of T’, and is shown in Figure 28. 


Hy 


Figure 28 A periodic extension fex¢(t) of f(t) 


The periodic extension fext(t) is a periodic function of fundamental 

period 7’, and we can find its Fourier series as normal. The resulting 
Fourier series will be equal to fex¢(¢) everywhere, and is equal to f(t) for 
0<t<T. So this Fourier series represents the non-periodic function f(t) 
inside its domain of definition, 0 < t < T. The periodic extension shown in 
Figure 28 is neither even nor odd, so the Fourier series contains both sine 
and cosine terms. 


With a little preparation, we can use f(t) to construct periodic functions 
that are either even or odd, before extending over all t. This is generally a 
sensible thing to do because the resulting Fourier series will be simpler. 
We make the following definitions. 
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In exceptional cases, the even 
periodic extension may have 
fundamental period tT = T (see 
Exercise 17). 
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Consider a function f(t) defined over a finite domain 0 <t < T. 


The even periodic extension of f(t) is given by 


De) Mor Veta 
Feven(t) = { f(-t) for -T<t<0, 


Feven (t =F 2T) = feven (t). 


An example of this extension is shown in Figure 29. 


Figure 29 The even periodic extension feven(t) of f(t) 


The odd periodic extension of f(t) is given by 


_ ff) tor Wt =< 7, 
foaa(t) = { —f(-t) for -T<t<0, 


Hoda’ 122 0 i —igdal ele 


An example of this extension is shown in Figure 30. 


Figure 30 The odd periodic extension foaa(t) of f(t) 


In general, both these functions have fundamental period 7 = 2T. 


Example 10 


Find the even and odd periodic extensions of the function 


JoH=6 for e= 1, 


and sketch these two extensions. 


Solution 


The even periodic extension is given by 


t forO<t<1, 
Joven) = { 


—t for-1<t<0O, 
Jevenll a 2) — Jeven\ tl 
This function is sketched in Figure 31, with the original function shown in 
orange. 


Figure 31 Even periodic extension 


The odd periodic extension is given by 


t forO<t<1, 
foaa(t) = 


t for -1l<t<0O, 
foaa(t + 2) = foaa(t). 


This function is sketched in Figure 32, with the original function shown in 
orange. 


Figure 32) Odd periodic extension 


In this particular case, both extensions can be expressed in alternative 
forms. The even periodic extension is 


jee) =i). tor =) <<, 
feven(t + 2) = feven(t), 

and the odd periodic extension is 
foaa(t) =t for -1<i<1, 
foaalt + 2) = foaal). 
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Exercise 16 


Consider the function 


t forO0<t<1, 
q(t) = ode -¢ 
57 9 orl <t<3, 


sketched in the margin. 


Define the even and odd periodic extensions of q(t), simplifying the 
formulas if possible. State the fundamental periods, and sketch each 
extension over a range of three periods. 


The following important example illustrates how a function defined on a 
finite interval can be represented by a Fourier series. 


Example 11 
The function 
a for 0 <7 < 1/2, 
fla)=< 2 
2d 


7b —2) for L/2<a<L, 
where d and L are positive constants, is defined on the finite interval 
0<a< UL. Express f(x) as a Fourier series that involves only sine terms. 


(Hint: With a change of variable to u = x/L, the integrals needed for the 
Fourier coefficients can be related to those calculated in Example 9.) 


Solution 


Because we are looking for a Fourier series that involves only sine terms, 
we need to consider the odd periodic extension of f(x), denoted by 
foaa(x). This is sketched in Figure 33. 


d+ foaa(2) 


Sy 


Figure 33 The odd periodic extension of the function f(x) 


The function foga(x) is odd and has period + = 2L, so its Fourier series 
takes the form 


[o.e) 
(nna 
Pate) = S- By sin (=) ; 
n=1 
where the Fourier coefficients B,, are given by 


Af? (Tx 
Bn = xz | foaala) sim (=) dx. 
But foaa(z) = f(x) on the interval 0 < x < L, so 


) L 
B= if f(x) sin (=) dx. 
Using the piecewise definition of f(x) given in the question, we obtain 
Ad L/2 L 
a= Ff vsin(*) det fi (L—2)sin(F*) ae i 
Making the suggested substitution u = x/L, we get 


/2 


The required integrals have already been evaluated in Example 9. 
Comparing with the working in that example, we conclude that 


1/2 1 
By, = 4d i usin(n7u) du + / (1 — u) sin(n7u) tu ‘ 
0 1 


8d | (nt 
By = ay sin (=) = 12. ven) 
So - 
8d 1. ¢nt\ . (nrx 
Foal) = 7a 2 am (5) sin (T=). 


Since f(x) and foaq(x) coincide on the interval 0 < x < L, this is the 
required sine Fourier series F(x) for f(z). 


For n = 1,2,3,4,5,6, 7, the values of sin(n7/2) are 1,0,—1,0,1,0,—1, so 
the first few terms in the Fourier series are 


8d[ . (mx L: . fone 1... form 
F(a)= 5 sin() - Ssin Tr + gp sin a 


Exercise 17 


Consider the same function f(z) as that discussed in Example 11. Within 
its domain of definition, 0 < « < L, represent this function by a Fourier 
series that involves only constant and cosine functions. 


To represent the original function f(x) in Example 11 by a Fourier series, 
we can use the odd periodic extension, obtaining a series that contains 
only sine terms (as in Example 11), or we can use the even periodic 
extension, obtaining a series that contains only constant and cosine terms 
(as in Exercise 17). 


Sometimes one choice is better than the other. In general, if we want to 
approximate a function by a truncated Fourier series, it is better to use a 
periodic extension that is continuous, rather than discontinuous. This is 
because, as pointed out earlier, the Fourier series for a continuous function 
converges more rapidly than that of a discontinuous function. So for the 
function discussed in Example 10 we would use the even periodic extension 
to obtain the Fourier series. 
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However, in the next unit we will use Fourier series to solve partial 

differential equations, and in that case our choice of an even or odd 
periodic extension is generally dictated by other factors, namely the 
boundary conditions. 


Exercise 17 is an exceptional case in which the even periodic extension has 
fundamental period 7 = L rather than 7 = 2L. This simplifies the 
calculations because we need integrals only over the range from 0 to L/2. 
If we were to treat the function in Exercise 17 as having period 2L, then 
the usual formula would eventually give the same Fourier series, although 
the calculations would be longer. In general, making the mistake of using a 
non-fundamental period rather than the fundamental period will always 
give the same final Fourier series, but at the expense of more labour. 


Exercise 18 


Consider the function 


1 for0<t<4, 
s(t) = { : 


=1 for 5 <ts 


(a) Define the even periodic extension, simplifying your answer as much 
possible. Sketch this function over —37/2 < t < 37/2, and state its 
fundamental period. 


(b) Find the Fourier series for the even periodic extension. 


(c) Define the odd periodic extension. Sketch this function over 
—a <t< 87, and state its fundamental period. 


(d) By slightly changing the definition of the odd extension at points of 
discontinuity, create a periodic extension that has fundamental 
period 7, and hence find the Fourier series. (Hint: You may find the 
result of Example 6 useful.) 


3 Working with Fourier series 


This section contains a miscellany of topics related to Fourier series. First, 
it takes a closer look at the fact that the truncated Fourier series for 
discontinuous functions are slow to converge, especially near the points of 
discontinuity. It then goes on to look at some useful techniques for 
calculating and manipulating Fourier series, including differentiating them. 


3.1 The Gibbs phenomenon 


You saw in Section 2 that a continuous function can be closely 
approximated by the first few terms of its Fourier series. As more and 
more terms are added, the truncated Fourier series and the original 


3 Working with Fourier series 


function become practically identical in value everywhere. For example, a 
truncated Fourier series containing only a few terms gives a good 
approximation for the continuous function in Figure 22. 


A different situation applies to discontinuous functions. For a given number 
of terms in the truncated Fourier series, the approximation is worse, 
especially around the points of discontinuity. In Figure 34(a) we give a 
comparison of F(t) with a square-wave function, while in Figure 34(b) we 
magnify a portion of this graph near the discontinuous point t = 0. Note 
that F9 deviates from the original function by oscillating around it. 


Fo 


(b) 


Figure 34 Comparison of a square-wave function (in black) with Fo (in 
red): (a) the first 20 terms in the Fourier series; (b) a magnification in the 
vicinity of a discontinuity 


Such a deviation occurs in the vicinity of any discontinuous function and is 
known as the Gibbs phenomenon, after the American mathematical 
physicist Josiah Gibbs (Figure 35). 


The main points of the Gibbs phenomenon are as follows. The truncated 
Fourier series F'y(t) (with N terms, where N is large) provides a good 
approximation to f(t) at points well away from any discontinuity. 
However, in the region of a discontinuity, Fy oscillates around f as shown 
in Figure 34. As N increases, Fy provides a better approximation to f, 
and the deviations are pushed into a region closer and closer to the 
discontinuity, but their amplitude does not diminish. Most importantly, at 
the point of discontinuity, as N tends to infinity, Fy always takes the 
average value of the function on either side of the discontinuity. We Figure 35 Josiah Gibbs 
highlight this crucial point below. (1839-1903) 


The value of a Fourier series at a point of discontinuity 


If f(t) is discontinuous at t = to, then the value of the corresponding 
Fourier series F(t) at this point is the average of the function values 
immediately above and below the discontinuity. That is, 


F(to) = 3 (f (to) + f(to)) 
where f(t;) is the value of f(t) just above to, and f (tg) is the value 
of f(t) just below to. 
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This description closely follows 
C. Lanczos (1966) Discourse on 


Fourier Series, Oliver and Boyd. 


Figure 36 Albert Michelson 
(1852-1931) 
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In fact, this rule also works at points where f is continuous. If f is 
continuous at to, then f(t) = f(t¢) = f(to) and hence 


F(to) = 5 (f(to) + f(to)) = f (to), 


so the Fourier series converges to f(to) as expected. 


History of the Gibbs phenomenon 


The American experimental physicist Albert Michelson (Figure 36) is 
primarily known for his 1887 experiment with Edward Morley, which 
showed that the speed of light is independent of the direction in 
which it is measured. This result undermined the concept of an ether, 
and prepared the ground for Einstein’s special theory of relativity. 


However, Michelson also invented many physical instruments of high 
precision. In 1898 he constructed a mechanical machine that could 
compute the first 80 Fourier coefficients for a function that was 
described numerically; the machine could also plot a graph of the 
truncated Fourier series and compare this with a graph of the original 
function. Michelson found that in most cases the input function and 
the truncated Fourier series agreed well everywhere. But for a 
discontinuous function, the truncated Fourier series agreed well except 
near the point of discontinuity. Michelson was puzzled and wrote to 
Gibbs, who explained the phenomenon mathematically and published 
his findings in Volume 59 of Nature (1898-9, pp. 200 and 606). 


Although the phenomenon is named after Gibbs, it was first noticed 
and explained half a century earlier, in 1848, by the obscure English 
mathematician Henry Wilbraham. This work was unknown to Gibbs. 


Example 12 


What is the value of the Fourier series for the square-wave function h(t) 
given in Exercise 14 (depicted here in Figure 37), at the point t = 1/2? 


———}o 


—37 On —T 0 T 27 3r Cit 


Figure 37 The square-wave function h(t) 
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Solution 


The function h(t) is discontinuous at t = 7/2. Just below t = 7/2, 
h(t) = 1, and just above t = 7/2, h(t) = 0. Hence at t = 7/2 the Fourier 
series converges to 


H(n/2) = $(0+1) = 5. 


We can compare this result with the Fourier series derived in Exercise 14. 
There we showed that 


But at t = 1/2, cos((2n — 1)t) = 0 for n an integer, so H(t) = $, in 
agreement with the average value derived above. 


Exercise 19 


(a) What is the value of the Fourier series for the function f(t) given in 
Example 8, at the point t = 1? 


(b) By comparing with the Fourier series at t = 1, show that 


7 as ih 
ae! (2n — 1)?" 


n=l 


3.2 Shifting the range of integration 


Suppose that we have a function g(t) with period 7. Then the integral 


f= [ g(t) dt 


—1/2 
is just the area under the graph of the function on the fundamental 
interval —7/2 < t < 7/2, as shown in Figure 38. If we shift the interval to 
—T/2+a<t<7/2+a, as in Figure 39, we see that the area lost on the 
left is equal to the area gained on the right. Therefore 


7/2 T/2+a 
fs g(t) a= [ g(t) dt. 


—1/2 —1/2+a 
In other words, when we integrate a function with period 7 over an interval 
of length 7, it doesn’t matter which interval of length 7 we use. 


In our formulas for the Fourier coefficients for a periodic function f with 
fundamental period 7 (equations (18)—(20)), the integrand is always 
periodic with period 7. Hence those equations are equivalent to the 
following. 


+v 


—7/2 7/2 


Figure 38 Area under g on 
the interval —7/2 < t < 7/2 


g(t) 


—T/2+a T/2+a t 
Figure 39 Area under g on 


the interval 
—7/2+a<t<7/2+e 
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The results in this subsection 
rely on the function being 
continuous. 
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Alternative formulas for Fourier coefficients 


The Fourier coefficients for any function f with fundamental period 7 
are given by 


1 to+T 
Ay== f° s(t)at @) 
Y to 
to+T D) 
y= Ff Hees (AE) at = 128,00 (42) 
i to a 
to+T 
Bn = - | f(t) sin (==) dt (n=1,2,3,...), > 
y to is 


where to can take any value. 


Equations (41)—(43) are sometimes easier to use than equations (18)—(20), 
as the following exercise illustrates. 


Exercise 20 

Show that the Fourier series for the function 
f(@)=a forf<a<3, 
fw +1) = fla), 

is given by 


[oe] 
‘p> = ( (sin ($n) cos (2nx) — cos (3nm) sin (2n72x)) . 


“i 


3.3 Differentiating Fourier series 
Suppose that the continuous function f(t) has the Fourier series 
(oe) [o-e) 
F(t) =Ao+ > An cos(Wpt) + > B, sin(w,t), 


n=1 n=1 


where Ap, An, By, and wy, are constants. 


Then we can ask: what is the Fourier series for the derivative 
f'(t) = df /dt? The answer is obtained by differentiating each term in F(t) 
in turn. So f’(t) has the Fourier series 


Co [o-@) 
= WnAr sin(wyt) + S> big ty COS Git) 
n=1 n=1 


Differentiation of Fourier series 


If a continuous periodic function f(t) with fundamental period 7 has 
the Fourier series F(t), then its derivative f’(t) has the same 
fundamental period 7, and its Fourier series is given by F’(t). 


This allows us to deduce the Fourier series for f’(t) from the Fourier series 
for f(t). This may not always be useful because the Fourier series for f’(t) 
is often easier to find than that for f(t). However, we sometimes need both 
these Fourier series; in such a case, it is possible to save some time by 
calculating the Fourier series for f(t) first, and then differentiating it. 


3 Working with Fourier series 


Example 13 


In equation (35) we showed that the function 


—t for-1<t<0Q, 
ft) = 
t forO<t<1, 


f(t+2) = f(t), 


has Fourier series 
r() =1-S3 —* Ls cos((an — 1)x2) 
ee nm —1)xt). 
2° 4 Qn-1Pr 


This function is shown in Figure 40. 


Figure 40 The function f(t) 


Deduce the Fourier series for the function f’(t), given by 
—1 for -1<t<0O, 
{ 1 for0O<t<1, 
f(t+2) = fd, 
and sketched in Figure 41. 


ty 


Figure 41 The function f’(t) 
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If you are very short of time, you 
may omit the rest of this unit. 
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Solution 


The function f(t) is continuous, as can be seen from its graph, and f(t) is 
its derivative. The Fourier series for f’(t) is given by the derivative of F(t): 


oe) 


4 d 
"(4)=0- ——— 2n—-1 
Fa)=0 d On = di — (cos(( )nt)) 
= 2 — sin((2n — 1)at). 
 (2n — 1)r 
In this case, f’(t) is undefined at the points ¢t = 0,+1, . because the 


slope of the function f(t) changes abruptly there. This . not affect the 
evaluation of the Fourier series F’(t), which converges to the average value 
of f’(t) either side of these points (e.g. F’(1) = F’(2) =... =0). 


Exercise 21 
The function c(t) = |cost| can be defined as 
c(t) =cost for —$ <i < §, 
c(t + 7) = c(t). 
From Exercise 15, this function has the Fourier series 
4 asd i 
=- = + - ee i ae cos(2nt). 
T 4n 
n=1 
Deduce the Fourier series for the discontinuous function 
s(t) =sint for -—=<t< §, 
s(t +7) = s(t). 


4 The exponential Fourier series 


This section will not be assessed in the exam or in continuous 


assessment. However, you are advised to study it because it contains 
ideas that are very useful in the physical sciences. 


4.1 The exponential Fourier series 


There is another form of the Fourier series that is used extensively in 
mathematics and the physical sciences: this is the exponential Fourier 
series. It is fully equivalent to the trigonometric Fourier series discussed 
so far, but uses the (complex) exponential function instead of sines and 
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cosines. This series has the advantage of being simpler and more concise 
than the trigonometric Fourier series, and it is often easier to evaluate its 
Fourier coefficients. Also, the exponential Fourier series is the starting 
point for Fourier transforms, an advanced topic that is used extensively in 
applied mathematics and science. 


Recall that a function f(t) with fundamental period 7 has a trigonometric 
Fourier series F(t) of the form 


F(t) = Ap + 3 An cos(Wyt) + 3 By, sin(wpt), (44) 
n=1 


n=1 
where Ag, A, and B, are constants, and w,, = 2nm/r for n = 1,2,3,.... 
You know that Euler’s formula relates the complex exponential function to 
cosines and sines, telling us that 


e'nt — cos(wpt) + isin(wyt), 
and conversely, 
iWwnt —tWyt tWwnt _ ,—twnt 
cos(W,t) = — sin(w,t) = —-— 
i 


Substituting these results into equation (44) gives 


A “B 
= n dWyt —iWyt n lWyt —iWnyt 
F(t)=4o+ > > (e +e ta =—€ ie 
n=1 n=1 
and we can then collect terms to get 
[o-e) S loc) 7 
_ An —1*Bn int An t+tBn ion 
F(t)=40+ 3 ae eee 2 
n=1 n=1 
For n = 0,1,2,3,..., we then define the constants 
A, —iB A iB 
Cy= Ao, Cy= 24, Ons we, (45) 


Notice that in the last of these definitions, the index used to label the 
constant C_,, is negative. For example, C_1 = (A; + 7B,)/2. Using this 
notation, the Fourier series can be written as 


[oe) [o-e) 
F(t)=Co+ >> Cre +S C_pe wm, 
n=1 n=1 
Recalling that w,, = 2n7/r, this can also be expressed as 
F(t) _ Ca a S> Cc ezinat/T hy > Os, eo 2inat/T (46) 
n=1 n=1 


The final sum on the right-hand side is a sum of terms 
oe eo 2int/T oa e fimt/T 4 oe e Sint /T 4 ou 
and this can be written as a sum over negative integers: 


—oo 
. c. ezinnt/T 


n=-l1 
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This result is proved in the 
Appendix. 


f denotes the complex conjugate 
of f. 
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Hence we can combine all the terms in equation (46) to get 


F(t) _ Ss" Ce ne (47) 


n=— CO 


where the sum is now over all the integers — positive, zero and negative. 
This is called the exponential Fourier series, and the constants C;, are 
called exponential Fourier coefficients. 


Equation (47) is more compact than equation (44), but a price has been 
paid. The sum now extends over all the integers, rather than just the 
positive integers, and the coefficients C;, are, in general, complex numbers 
(assuming that A, and B, # 0 are real). Nevertheless, the exponential 
Fourier series has some clear advantages. Given a function f(t) with 
fundamental period 7, it turns out that the Fourier coefficients C,, are 
given by the formula 

1 7/2 

Cn == f(the 2/7 dt (n = 0, +1, +2,...). 
T J—1/2 


This single formula compares favourably with the three separate integrals 
needed for Ag, An and By. 


The results obtained above are summarised in the following box. 


Exponential Fourier series for periodic functions 


For a periodic function f(t), with fundamental period 7, the 
exponential Fourier series is 


[e-@) 
= Sy oe, (48) 
n=—co 
The Fourier coefficients C,, are calculated from 


1 7/2 
Cr=—f  fQermldt (n= 0,41,42,...). ee) 
—7/2 


Even if we ultimately want to find a trigonometric Fourier series, it can 
make sense to begin with the exponential Fourier series, using 

equation (49) to find the C;,, and then use the inverse of equations (45), 
namely 


Ag=Co; Ag=Ge PC, Bei, —C»y) (es T), (50) 
to find Ag, A, and By. 
If f(t) is real, then we have f(t) = f(t) and equation (49) gives 
— jf ft? 
—— fie!" eH C_,. 
T —7/2 


Combining this with equations (50), we obtain the following. 
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Fourier coefficients for real functions 
Ap=Co; Ay =2Re(C,), By==2Im(C,) (m= 1). (51) 


Example 14 
(a) Find the exponential Fourier series for the function 
f(t)=t for -t<t<z, 
f(t + 2n) = f(t). 
Hint: You may find the following standard integral useful: 


1 
ee i= qu at — 1)e. 
(b) Use the exponential Fourier series derived in part (a) to derive the 
corresponding trigonometric Fourier series. 
Solution 


(a) f(t) has fundamental period 7 = 27. Using equation (48), its 
exponential Fourier series takes the form 


Fi) = 3 Ce 


n=—CoO 


From equation (49), the Fourier coefficients are given by 


i. * 
C.= = _ FO a de 
a ae 
=—]/ te dt. 
20 . 


—T 
For n = 0, we have 


1 Tv 
a= =| tdt =0 
a 


because the integrand is an odd function and the range of integration 
is symmetric about the origin. 


For n # 0, the standard integral given in the question gives 


1 inti 
= acm? [(—int — 1)e rl 
1 
a= ((-inm — 1)e°"* — (inw — 1) e'"") 
™m 


e*'™ — cos(nm) + isin(nr) 
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So 


ee ee 
C.= ema 2int) 


The exponential Fourier series is therefore 
P= d> Leap, 
n=—0o 


n4£0 
where the notation at the bottom of the summation symbol means 
that we sum n over all the integers except zero. 
(b) Using equations (51), we get 


Ag = An = 0, 

2 
_ —yyrrt. 
2 (41) 


1 


Bn = —2Im(C,) = —2 
mr 


(-1)"| = 
The corresponding trigonometric Fourier series is therefore 
2 
F(t)= 5° = (-1)""' sin(nt). 
() = Dg (a sinlnt) 


This agrees with the trigonometric Fourier series found in Exercise 11. 


Exercise 22 
(a) Find the exponential Fourier series for the function 
fHSe™ toe —0¢ <1; 
ft+2) = f@, 
where a is a real but non-zero number. 


(b) Use your answer to part (a) to find the corresponding trigonometric 
Fourier series for f(t). 
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However, in 1965, James Cooley and John Tukey announced the 
discovery of the FFT, which could calculate N Fourier coefficients in 
around N InN operations. This improvement in speed is crucial when 
it is necessary to compute millions or billions of Fourier coefficients. 
Subsequently, in 1984, it was discovered that the algorithm was 
already known to the great mathematician Carl Friedrich Gauss as 
early as 1805 — pre-dating even Fourier’s work. 


The FFT is of huge importance. It is used ubiquitously in the 
mathematical and computational sciences, in topics from solving 
differential equations to algorithms for quick multiplication of large 
integers and matrices. It also has wider applications in the modern 
world, where it is used billions of times a day: 


e for analysing and detecting signals 


e for coding and decoding audio and speech signals, e.g. MP3 
encoding 


e for digital TV (DVB) and digital audio radio (DAB) broadcasting 
e for background noise reduction in mobile telephony. 


In fact, you couldn’t log on to a Wi-Fi network or make a call on your 
mobile phone without the FFT. The FFT has rightly been described 
as ‘the most important numerical algorithm of our lifetime’ (Gilbert 
Strang). 


4.2 An application to differential equations 


Here we illustrate how an exponential Fourier series can be used to 
construct the solution of a differential equation. 


As motivation, consider the following problem. If a tyre fails on the wheel 
of a vehicle (Figure 42), the wheel may no longer be circular, and the 
suspension of the vehicle will be subject to a periodic force, with period rT. 
The manufacturer wishes to estimate the effect of this periodic force on the 
body of the vehicle. 


The motion of the body of the vehicle can be modelled by a damped, 
driven harmonic oscillator, of the type considered in Unit 3, with a 
periodic driving term. The differential equation that must be solved is 


#+ We + wee = f(t), (52) 


where the driving term f(t) is a given periodic function, with fundamental 
period 7. Here, I is proportional to the damping constant, and wo is the 
angular frequency of the harmonic oscillator in the absence of damping or 
external forces; this is called the natural angular frequency. 


Figure 42 Can an aircraft 
survive landing on this 
damaged tyre? Fourier series 
can solve the relevant 
differential equation. 


In this model, x represents the 
vertical displacement of the 
body of the vehicle, relative to 
its equilibrium position. f(t) 
depends on the properties of the 
burst tyre, and 7 depends on the 
speed of the vehicle and the 
diameter of the tyre. 
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We can solve the differential equation in the usual way: first find the 
complementary function x,(t) that satisfies the auxiliary equation 

&e+ 2a. + wer, = 0; then find a particular solution 2; finally, construct 
the general solution 7, = x + x. Finding the complementary function is 
straightforward, but this term dies away as time increases, so the motion is 
eventually closely approximated by the particular solution, and that is 
what we concentrate on finding here. 


Since the driving term f(t) is a given periodic function, with fundamental 
period 7, we can compute its exponential Fourier series: 


fo= > frexp (=) = >> frei, (53) 


T 


n=—CoO n=—co 


where the f,, are the Fourier coefficients for f(t) for n = 1,2,3..., and 


w = 2n/r is the angular frequency of the driving force (not to be confused 
with the natural angular frequency of the system, wo). 


Let us seek a particular solution x(t) of equation (52) that is also a 
periodic function with period 7. Then we can also express x(t) as a Fourier 
series, with Fourier coefficients x: 


a=. So mye (54) 


n=—0o 
If we are able to determine the Fourier coefficients x,,, then equation (54) 
will give us the required particular solution of equation (52). 


The differential equation involves the derivatives « and 7, and we can get 
expressions for these by differentiating equation (54) term by term: 


co 
a(t) = >. inw tne, (55) 
nN=— Co 
(oe) [oe] 
Dt) = S- (inw)* 2," = > (—n?u?)ane™. (56) 
n=—oo n>=—0Co 


These are the exponential Fourier series for « and %. 


Substituting equations (53)—(56) into equation (52), we obtain 


co 


Co 
) (—n?w* + 2Pinw + w2)a,e™* = y fe, 


n=— CO n=—CcoO 


The sums on both sides of this equation are Fourier series. They can be 
equal only if all of their coefficients are equal, so 


1 
STE 57 
. (we — nw) + 2Pinw f ee 


The particular solution that we seek is therefore 


co 


1 inust 
es eat 58 
oe) Dy (we — n2w*) + 2Tinw Ine oa 


n=—Cco 
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Using equations (51), this could also be expressed as a Fourier series 
involving sines and cosines, but we will not do this here. 


For small values of the damping parameter, I ~ 0, we get 


a 


Ln X& = 
ua — n2w? 


So if f, #0, the Fourier coefficient x, can be very large when wo ~ nw, for 
n=0,1,2,..., ice. whenever the natural angular frequency is an integer 
multiple of the angular frequency of the driving force. This is a 
generalisation of the phenomenon of resonance discussed in Section 5 of 
Unit 3. 


Example 15 
Find a particular solution of the differential equation 
#+ We +wee = f(t), 
where the driving term f(t) is the function discussed in Example 14. 
Solution 


From Example 14, we have tT = 27 so w = 27/7 = 1, and the exponential 
Fourier series for f is given by 


RG) = 3 ie. 


where 
fo=0 and f,=~(-1)" (n#0). 


From equation (57) we see that the differential equation has a particular 


solution 
Co 
z(t) = Ss" ne 
n=—0o 
where 


i(—1)” 1 
nm (we — nw) + 2Pinw 


fg =0 and = (a 0). 

The expression for x, (n # 0) can be simplified by the usual trick of 
multiplying the top and bottom by the complex conjugate of the bottom 
(see Unit 1). In the present case, the top and bottom are multiplied by 
(we — n?w*) — 2Pinw. Rearranging, and substituting the Fourier 


coefficients back into the exponential Fourier series, we conclude that 


Co 2 é 
i(-1)”) (we —n?u")—-2WTinw 
z(t) = a ev eine a Be eu It is easy to see that the 
n (wo — n?u?)? + (2D'inw) imaginary terms in the sum are 
n#£0 odd functions of n. The 
ae ae 5 imaginary part of x(t) is 
(—1)”) 2D nw + i(wg — n°") eo therefore equal to 0 because the 
yy 3 3 (cos(nt) + isin(nt)). ‘buti th , 
n (we = n2ys2)2 — AT? n2w2 contributions with n > 0 exactly 
n=—00 cancel those with n < 0. 
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Learning outcomes 


After studying this unit, you should be able to do the following. 


e Understand the terms angular frequency, period, fundamental period 
and fundamental interval, and be able to obtain their values for a 
periodic function. 


e Give correct specifications of piecewise defined functions. 


e Determine whether a function is even or odd, and use evenness and 
oddness to simplify definite integrals over a range that is symmetric 
about the origin. 


e Calculate the trigonometric Fourier series for any periodic function, 
taking advantage of evenness or oddness where appropriate. 


e Understand how to modify a function defined on a finite interval to 
give its even or odd periodic extension, and hence represent the 
function by a trigonometric Fourier series. 


e Calculate the value of a Fourier series at a point of discontinuity. 


e Where appropriate, simplify the calculation of Fourier coefficients by 
shifting the range of integration. 


e Differentiate Fourier series to obtain new Fourier series from old. 


Appendix: proofs and orthogonality 


This Appendix is optional and will not be assessed. It justifies the 
equations used to calculate Fourier coefficients and, more importantly, 
casts further light on the analogy between Fourier series and vectors. 
This analogy is frequently used in areas of advanced mathematics and 
in subjects like quantum mechanics. 


Formulas for trigonometric Fourier coefficients 


Given a function f(t) with fundamental period 7, its trigonometric Fourier 
series is defined to be 


F(t) = Ane cos (2 “4 +P, sin (2), (59) 


n=1 


where Ag, A, and B,, are the Fourier coefficients for f(t) for n = 1,2,3,.... 
This series is equal to the original function f(t) (except at isolated points 
where f(t) is discontinuous). So we write 
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The main text showed how to calculate Ap by integrating both sides of 
equation (59) from —7/2 to 7/2. The integrals of the sine functions vanish 
because their integrands are odd. The integrals of the cosine functions also 
vanish because we are integrating over a whole number of their periods. 
Explicitly, if n 4 0 is an integer, 


[ (=) | rT eas 
cos | —— ] di = |——sin 
—1/2 7 2nt T n/9 
= = (sin(nm) — sin(—n7m)) = 0. (60) 


Hence integration of equation (59) from —1/2 to 7/2 gives 


7/2 
/ F(t) dt = Agr. 
—1/2 


Using f(t) = F(t), we obtain the following expression for Ao: 


7/2 
Aiea - | f(t) dt. 


T —1/2 
The main text gave only a sketch of the derivation of the remaining 
Fourier coefficients, indicating how Ag can be found. We now give more 
details. The key idea is as follows: we multiply both sides of equation (59) The calculation of Apo is a trivial 
by a suitable function, chosen so that when we integrate from —r1/2 to 7/2, example of this idea, in which 
the integrals of all the terms vanish, except one. This remaining non-zero _—‘ the multiplying function is the 
integral is multiplied by the Fourier coefficient that we want to find, and a matt tune 2) 
simple rearrangement then gives a formula for that coefficient. 


To implement this broad plan of action, we will use the following set of 
standard integrals, where n and m are any positive integers: 


72 2nat\ . ( 2mat 

il cos sin dt = 0, (61) 
—1/2 T T 
a Qnnt 2 - 

/ cos ( nT ) aos ( a) _ ve for n =m, (62) 
=?) T T 0 forn Am, 


ale Qnat 2mat = 
/ sin ( nT ) sin ( mr ) a ce for n =m, (63) 
7/2 ‘i a 0 forn Am. 
Equation (61) is obviously true. The sine function is odd and the cosine 
function is even, so their product is an odd function. This is integrated 


over a range that is symmetric about the origin, so the integral is equal to 
Zero. 


To establish equation (62), we use the trigonometric identity 
cos A cos B = $[cos(A — B) + cos(A + B)], 


which gives 


w-(22) om (22) = fon 252) sae. 


Let us assume for the moment that n ¢ m. Then, since n and m are 
positive integers, n — m and n+ ™m are non-zero integers. We can therefore 
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use the result of equation (60) (with n replaced by n + m) to show that 
the integral in equation (62) is equal to zero when n 4 m. This leaves the 
case n = m, for which the above trigonometric identity gives 


(==) (==) 1 | (=) 
os {| —— ] cos = 1+ cos : 
T T 2 T 


Again, the integral from —r/2 to 7/2 of the cosine term gives zero, and we 
are left with 


1/2 2nrt 2Qn7rt 7/2 4 T 
cos cos dt = —dt=-—. 
—1/2 T T —1/2 2 2 


This completes the proof of equation (62). 


Equation (63) is proved in a similar way, using the trigonometric identity 
sin Asin B = $[cos(A — B) — cos(A + B)], 


which gives 


oe (==) a (=) _ : cos (=e ar) ae (=e snr) . 


For exactly the same reasons as above, the integrals from —7/2 to 7/2 of 
these terms are equal to zero provided that n # m. For the special case 
n =m we have 


; (==) . (==) 1 | (=) 
sin {| —— ] sin = —|1—cos ‘ 
F T 2 7 


The integral from —7/2 to 7/2 of the cosine term again gives zero, so 


fe 2nat\ , 2nat 72 T 
sin sin | —— } dt = -—dt=-, 
—1/2 Te T —1/2 2 2 


completing the proof of equation (63). 


Equations (62) and (63) can be tidied up using a shorthand notation that 
The Kronecker delta symbol is is surprisingly useful. The Kronecker delta symbol is defined by 
named after the German 
mathematician Leopold _ 
Kronecker (1823-1891). i 


1 forn=m, 
0 forn Am. 


Using this notation, the integrals that we need can be expressed as follows. 


Integrals needed to find Fourier coefficients 


aie 
/ cos (==) sin (==) di—0, (64) 
—1/2 Ti Te 
7/2 
fl cos (==) cos (==) Ce = ae (65) 
—1/2 T T 2 
Gf 2 
i sin (==) sin (=) dt = — One (66) 
—1/2 if T 2 
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Using these integrals, we can easily obtain formulas for the Fourier 
coefficients A, and B, for n = 1,2,3,.... 


Let us multiply both sides of equation (59) by cos(2mat/r), where m is a 
positive integer, and then integrate from —7/2 to 7/2. Integrating each 
term in turn and using equations (64) and (65), we get 


2 2mrat = i 
/ F(t} 0 ( — ) d= AF dam +0 


—1/2 


In the sum on the right-hand side, the Kronecker delta symbol ensures 
that practically all the terms are equal to zero. Only the term with n =m 
survives. Using the fact that F(t) = f(t), we therefore conclude that 


7/2 
Ye f(t) cos (7 


T J—7/2 


mat 


) dt (m=1,2,3,...). (67) 


Similarly, multiplying both sides of equation (59) by sin(2mat/r), where m 
is a positive integer, and then integrating from —7/2 to 7/2 gives 


7/2 2mat - T T 
F(t) sin | —— ] dt = Bn = onm = =Bm. 
[., (sin ( . ja eo oa 5 
So, using the fact that F(t) = f(t), we get 
re 2 
Bn =- f(t) sin ( 


T J—1/2 


mart 


)a (m = 1,2,3,...). (68) 


Equations (67) and (68) give the Fourier coefficients A,, and B,, for 
m = 1,2,3,.... We may, of course, replace the label m by n to recover 
equations (19) and (20). 


Formulas for exponential Fourier coefficients 


Very similar arguments apply to the exponential Fourier series for a 
function f(t) with fundamental period 7. In this case, we define 


n= Yee (69) 


n=— Co 


This Fourier series is equal to the original function f(t) (except at isolated 
points where f(t) is discontinuous). So we can write 


f(t) =F). 


We can again ‘pick off’ the Fourier coefficients by multiplying both sides 
by a suitable function and integrating. In this case, the standard integral 
that unlocks the coefficients is as follows. 


ie ; ; 
/ oe 2imat/T dint /T dt = one (70) 
—1/2 


where n and m are integers and dpm is the Kronecker delta symbol. 
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This integral is quite easy to establish. Assuming that n 4 m are integers, 


we get 
7/2 ; ; 7/2 ; 
/ e 2imat/T 2innt/T d= / e2i(n—m)at/7 dt 
—71/2 —71/2 
7 T Ce er 
2i(n — m)r [e i 
~ T i(n—m)r _ —i(n—m)r 
2i(n — m)r (« . ) 
Recall that sina = aed Se sin((n — m)r) = 0 
eca sin x = 7 = =a —0. 


On the other hand, if n = m, the integrand becomes equal to 1, so 


7/2 . ; 7/2 
/ gern firme ip / eX 
—1/2 7/2 


which completes the proof of equation (70). 


Given equation (70), it is easy to derive a formula for the Fourier 
coefficients. We just multiply both sides of equation (69) by the factor 
e 2mnt/T and integrate term by term from —1/2 to 7/2. This gives 


7/2 ; oo 
/ F(t) e~20mrtl de — » Cbs: 
—1/2 


n=—coO 


Again, the Kronecker delta symbol ensures that the sum on the right-hand 
side reduces to the single term C,,7. Hence, using the fact that 
F(t) = f(t), we get 


1 7/2 
Cm = ~ | f(t) Pe 
T J—7/2 


Replacing the arbitrary label m by n, we then recover equation (49). 


Orthogonal functions 


Finally, let us return to the analogy between Fourier series and vectors 
mentioned earlier in the text. 


You know that a vector in three-dimensional space can be expressed as 
V =U; 1+ ty J + zk, (71) 


where i, j and k are Cartesian unit vectors, and vz, vy and vz are the 
corresponding components of v. A key property of these unit vectors is 
that they are mutually orthogonal. This means that their scalar products 
satisfy 


i-j=i-k=j-k=0. (72) 


The unit vectors also have unit magnitude, so 


i-i=j-j=k-k=1. (73) 
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These properties allow us to isolate any one of the components of v. For 
example, taking the scalar product of equation (71) with i and using 
equations (72) and (73), we get 

i-v =v; (i-i) + vy (i-j) + v, (i-k) 
Vz (1) + Vy (0) + vz (0) 
v 


a 


Note that taking the scalar product of i with v is achieved by taking the 
scalar product of i with each of the terms on the right-hand side of 
equation (71). Technically, we say that the scalar product is distributive. 
The component v; can then be isolated because the unit vectors are 
orthogonal. 


Similar language can be used to describe the calculation of Fourier 
coefficients. In this case, equation (71) for a vector is replaced by the 
Fourier series for a periodic function (equation (59) or (69)). Instead of 
taking the scalar product with a unit vector, we multiply by a suitable 
function and integrate over the fundamental period 7. The process of 
integration is also distributive, meaning that we can integrate each term 
on the right-hand side of the Fourier series in turn. Corresponding to the 
orthogonality of the unit vectors, we then have the standard integrals in 
equations (64)—(66) and (70): 


7/2 D) 
/ cos ( m) sin (==) dt = 0 
—1/2 Tp T 
7/2 
ip cos (==) cos (=) dt = = Onis 
—1/2 T T 2 
7/2 2nit 2mat Ti 
—1/2 T T 2 


7/2 ; 
fi eo 2imnt/T inant /T dt = Tb nm: 
—1/2 


This is what allows us to pick off individual Fourier coefficients from the 
sum. Because of these analogies, we say that the functions 


2niat Anrt 6nat 

cos , cos , Cos 5 eaees 
T T T 

. Q2nit : Annt . 6nat 

sin | —], sin{ —], sin| —], ..., 
a T T 


and the constant function 1 are orthogonal functions. Similarly, the 
functions 


eu, ere. Ee as 


are said to be orthogonal. In both cases, orthogonality refers to the fact 
that certain integrals of these functions (given in equations (64)—(66) 
and (70)) are equal to zero. These integrals are sometimes called 
orthogonality integrals. 
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A minor difference compared with vectors is that the orthogonality 
integrals do not give 1 when n = m, so we do not have an analogue for 
equation (73). This could easily be remedied by scaling the functions, but 
this is not needed for our purposes. The important point to take away is 
that you can visualise the process of calculating Fourier coefficients as 
being similar to the process of projecting a vector onto the coordinate axes 
to find its components. 


Solutions to exercises 


Solution to Exercise 1 


(a) The function sin (42) has angular frequency w = i, so its fundamental 
period is T= 2a/w = 8n. 


(b) The function cos (22) has angular frequency w = 2, so its 


fundamental period is T= 27/w = 5z. 


(c) The function sin ($2) + 2.cos (22) is the sum of two functions: 
sin ($7) and 2cos (27). The complete set of periods for sin (4 
given by the positive integer multiples of 87, that is, 


87, 167, 247, 327, 407, 487, .... 


i) is 


The complete set of periods for 2 cos (22) is given by the positive 
integer multiples of 57, that is, 


dm, 107, 157, 207, 257, 307, 357, 407, .... 
The smallest period that these functions have in common is 407. This 
is the fundamental period of sin (42) + 2cos (22). 
Solution to Exercise 2 
The given function has period 3, so q(t + 3) = q(t). Hence 
g(1000) = ¢(1 +3: x 333) = ¢1)=1, 
where the final value is obtained by examination of Figure 4. Similarly, 


q(—77) = q(1 — 78) = q(1— 3 x 26) = q(1) = 1. 


Solution to Exercise 3 


Looking at Figure 11, we see that q(t) = —st for —2 <t<0. Also, 
q(t) =t for 0 <t¢<1, and q(t) = 3% —$t forl<t<3. 


Hence over the fundamental interval —3 <t< 3, q(t) can be defined by 


—3t © for -3 <t <0, 
qij=< t forO0<t<1, 
3—}t forl<t< 3, 

q(t + 3) = q(t). 
Solution to Exercise 4 


A sketch of the function is shown below. 


Solutions to exercises 
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Solution to Exercise 5 


This function is shown in the figure below. Note the positions of the open 
circles. 


chy 


Solution to Exercise 6 


(a) u(t) has discontinuities at t = +1,+3,+5,..., ie. at t= 2n+41 forn 
an integer. 


The fundamental period is 7 = 2. 
(b) The piecewise definition is 
t+1 for-1<t<0, 
u(t) = 
1 forO<t<1, 
u(t + 2) = u(t). 
(c) Since u(t + 2n) = u(t) for n an integer, u(99) = u(—1) = 0 and 
#(100) = (0) = 1, 
Solution to Exercise 7 
(a) If f(x) = 2° — 32, then 
f(—2) = (-2)9 - 3(-2) = -(29 - 32) = -f(2), 
so this function is odd. 


(b) The functions sinz and sin(42) are both odd, so if 
f(x) = 2sinz + 3sin(4z), then f(x) is an odd function. 


(c) Each term in the sum 5 + 2cos2 + 7cos(4x) is even, so this function is 
even. 


(d) The constant function 4 is even and sin z is odd, so if 
f(x) =4-2singz, then f(—z) = 44 2sinz. So f(x) is neither even 
nor odd. 


(e) If f(x) = 22 cos(3x), then 
f(—ax) = —2x cos(—3x) = —2x cos(3x) = —f(zx), 


so this function is odd. 


Solutions to exercises 


Solution to Exercise 8 


(a) The function x? is odd and the function cos(2x) is even, so the 
integrand is odd. The range of integration is symmetric about the 
origin, so the integral vanishes, i.e. 


1 
/ x cos(2x) dx = 0. 
=i 


(b) The function sin(2x°) is odd and the constant function 3 is even. 
Since the range of integration is symmetric about the origin, we have 


2 2 
/ (3 + sin(2x?)) dx = / 3dxz We have used the fact that a 


—2 —2 constant is an even function, but 
2 2 this is an optional step. 
= 6 | tae= |6a) = 12. 
0 


Solution to Exercise 9 


Looking at Figure 3, we see that p(t) has fundamental period 7 = 2, 
therefore from equation (10), its Fourier series has the form 


P(t) = Ap + » Ay cos(nmt) + S- B,, sin(nat) 


n=1 n=1 
= Ao + (Aj cos(mt) + Ag cos(2mt) +--+) 
+ (By, sin(xt) + By sin(2rt) +---). 
Comparing with equation (2), we see that Ag = A, = Ag = A3 = Ay = 0 
and 


4 4 


Pi Bz =0, Bs =— Fo Bsa =0. 


Solution to Exercise 10 


From Figure 2, it is clear that |cost| has period t= 7. Hence using 
equation (14) we have 


1 7/2 1 m/2 5 m/2 

Ane ~ | a= - | (conaai= =| Icos t| dt, 
T J—7/2 T J—x/2 7 Jo 

where the last step follows because |cost| is an even function. 


But over the range —7/2 < t < 7/2, cost is positive, so |cost| = cost. 


Hence 
9 m/2 
Ag = - | cost dt 

T JO 
2,. m/2 

— — [sin t], 
2 2 
— (sin(1/ ) — sin(0)) = 


in agreement with the stated Fourier series in equation (1). 
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Solution to Exercise 11 


This function is sketched in the figure below. 


Shy. 


f(t) is an odd function. It has fundamental period 7 = 27, so its Fourier 
series (equation (17)) takes the form 


F(t) = Ao + ¥> An cos(nt) + 5° Bn sin(nt). 
n=1 n=1 
From equation (18) we get 
al Tv 
Ao = (t) dt —_ 0, 
27 Jn 
because f(t) is odd and the range of integration is symmetric about the 
origin. 


From equation (19) we get 


1 Tv 
An =- fijcos(nt)dt (i—1,2,3,.«.). 
T S71 
Because f(t) is odd and cos(nt) is even, the integrand f(t) cos(nt) is an 
odd function, so when this is integrated from t = —z to t= 7, we get zero. 
Hence 


Age: We 1,9 ,2).+.) 
Finally, from equation (20) we get 


Tv 1 Tv 
Rao) soa ] bsinilnd) di. 
Tf a 7 


Si 


Using the standard integral in equation (32), we get 


Lies 
Bee = a [sin(nt) — nt cos(nt)| 


= —-(sin(nn) — ntcos(nm) — (sin(—n7) + nz cos(—n7))). 


Since sin(na) = 0 and cos(n7) = (—1)” for n an integer, this simplifies to 


2 


By, = (—2nn(-1)") = =o) ale i= 1,93 .253)s 


nT 
Putting these results together, the required Fourier series is 


[oe) 


F(t) =>0 “(14 sin(nt). 


n=1 


Solution to Exercise 12 


The function is sketched in the figure below. 


1 f(z) 
} ! 
| 


This function is neither even nor odd. It has fundamental period 7 = 2, so 
its Fourier series (equation (17)) has the form 


F(x) = Ag+ x A, cos(n7x) + > B, sin(n7a). 


From equation (18) we get 


af 
Ag = 5 | fayae. 


To integrate a function defined on pieces, we integrate each piece in turn 
using the correct value of the function on each piece. So 


Ao=3(f @+0ae+ [ 140) 
4 (da? +2]? +[2],) =43(-G-D+1) =2 


Similarly, equation (19) gives 


1 
Ay = sf. ple)cos(waryde (n= 1,2, 3, was) 


sO 


0 1 

An ii (a + 1) cos(naa) dx + | cos(n7a) dx. 
=f 0 

For the integrals of cos(n7ax), we can join the two integration ranges 


together. Hence 
0 1 
An =) x cos(nra) dx +f cos(n7a) dx. 
=i =i 


Using the standard integral in equation (33), we then get 


AZ | (cost) ee sin(ue)) 


1 
1. 
+ = sin(nn) 
Lag i 


1 
(nr)? (cos(0) — cos(—nm)) 

1 dee 
=a ) (n=1,2,3,...), 


where we have used sin(n7) = 0 and cos(n7) = (—1)” for n an integer. 
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Also, equation (20) gives 


sf. f(x) sin(naa) dx 


0 1 
= | (a + 1) sin(naa) dx + | sin(n7a) dx 
=i 0 


0 i 
a0) x sin(n72) ax+ | sin(nax) dx. 


—1 —1 


Using the standard integral in equation (32), we get 
pen] 
—|—cos(n7x)|. 
nT -, 


Since uh, = 0 and cos(n7) = (—1)” for n an integer, we get 


= [aa into) — ne cos(nz)) . 


Bn = (0-0) -— (sin(—nm) + nm cos(—nr)) 


oa 
(nm)? 
=. (cos(nm) — cos(—nm)) 


= -—(-1)" (n=1,2,3,...). 


Putting all these results together, the required Fourier series is 


a. Tay 

Fa)= rl + 3 2 72 — (—1)”) cos(nzz) oS sin(n7z). 

The first few A,, are 
2 

wa pet te Us Bae Ce, Bee 

Hence the Fourier series can also be written as 
ti e 
F(a) = + ae aati Gt — 1)rx) — y= sin(n7z). 


n=1 
Solution to Exercise 13 


It is clear from the figure given in the question that f(t) is an even 
function with fundamental period 7 = 2. Following Procedure 3, its 
Fourier series involves only constant and cosine terms, and takes the form 


F(t) = Ag+ - A, cos(nat). 


n=1 


The constant term is 


ve , al 


The remaining Fourier coefficients are 


1 1 
Ae : Picontnnydi = 3 | ieoxlim\ de 
0 0 
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This integral can be evaluated using equation (33). We get 


Az, = one [cos(nzt) + nat sin(nat)] 5 


= To: (cos(nm) — cos(0)) 
y) oa —_ 
= tame (Y) 1) Geos) 


The Fourier series is therefore 


F(t) = 5+ ~ aa ((-D” ~ 1) coa(nat), 


which agrees with the answer given in Example 7. 


Solution to Exercise 14 
The function h(t) is sketched in the figure below. 


1 h(t) 
| | | 
| | | 
| | | | | | 
| | | | | | 
| | | | | | 
—0 OC 
—3T —20 —T 0 T 27 


Clearly h(t) is even and has fundamental period 7 = 27. Following 
Procedure 38, its Fourier series involves only constant and cosine terms, 


and takes the form 


A(t) = Ao+ 3 A, cos(nt). 


n=1 


The Fourier coefficients are evaluated as follows: 


| “Ri cosled di 
0 


m/2 
| cos(nt) dt 
0 
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Hence the Fourier series is given by 
1 w2 
Aii)= 5 + 2 — sin (=) cos(nt). 


For n = 1,2,3,4,5, the values of sin(nz/2) are 1,0,—1,0,1, so the first few 
terms of the Fourier series are 


AG) = ; + = cos(t) - = cos(3t) + — cos(5t) —--- , 
in agreement with the Fourier series stated in equation (7). 
Only the odd values of n contribute to the Fourier series. Putting 
n = 2m —1 and noting that equation (24) gives 

sin((2m — 1)a/2) = (-1)™"?, 


this Fourier series can also be written in the alternative form 


CO 7 _4\m+41 
H(i) =5+- a —_ ~cos((2m — 1). 


Solution to Exercise 15 


It is clear from Figure 2 that c(t) is even and has fundamental period 
T=. Following Procedure 3, its Fourier series involves only constant and 
cosine terms, and takes the form 


C(t) = Ag + 3 Ay cos(2nt). 


n=1 


On the interval 0 < t < 1/2, we have c(t) = cost. Therefore 


9 n/2 

Ag = - | \cos t| dt 
T JO 
9) m/2 

= - | cost dt 
T JO 
2,. m/2 2 
— |sin i = 
Similarly, 


4 m/2 
A= - | cos t cos(2nt) dt. 
T Jo 


Using the standard integral given in the question, with a = 1 and b = 2n, 
we then get 


As = 4 [2ncostsin(2nt) — cos(2nt) sint]*/ 
ae An? — 1 5 
_ 4 ( 2ncos(m/2) sin(nm) — cos(n) sin(7/2) 
ot 4n? — 1 
4 1 
= = Ane 1. cos(n7). 
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But cos(n7) = (—1)", so 


4 (—1)""1! 
A, = -~—— a aa ee 
nm 4n?—1 _ So) 
Thus the Fourier series is 
2 ft. (=e 
C(t) = = + - ps Ge 1 cos(2nt). 


The first few terms of this Fourier series are 


4 
Ct) = 2 (3 + + cos(2t) - — cos(4t) + o cos(6t) — -- -) 


in agreement with equation (1) in the Introduction. 


Solution to Exercise 16 


Using the definition of the even periodic extension, we have 


t for0<t<1, 

3_1 rd 
ee st forl<it<3, 

—t for -1<t< 0, 


8424 for -3<t<-1, 
deven (t + 6) = deven (t). 


This function has fundamental period 7 = 6, and its formula cannot be 
made much simpler. Its graph is sketched below. 


> 
t 
The odd periodic extension is given by 
t for0<t<1, 
3— ht forl<t<3, 
doaa(t) _ 
t for -1<t< 0, 
3 1 
—5 — oe for -3 <t<-l, 
doda(t + 6) = goaa(t). 
This function has fundamental period 7 = 6, and its graph is sketched 
below. 
A 
t 
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By examining this graph, we see that the formula can be simplified to 
t for 1 24< 1, 


fe) t)= 
qoaa(t) es for <= 5, 


doaa(t + 6) = qoaa(t). 


Solution to Exercise 17 


Because we are looking for a Fourier series that involves only constant and 
cosine terms, we need to consider the even periodic extension of f(x), 
denoted by feven(x). This is sketched in the figure below. 


The function feven(x) is even, and from the above sketch has period 7 = L, 
so its Fourier series takes the form 


= 2 
Feven(«) = Ao + )~ An cos ( a 


L 


n=1 


where the Fourier coefficients Ag and A, are given by 


L/2 
Ao a if foveal 2) dx, 
0 


A phil? Q2QnTx 
A= f fant) 08 ( L ) ac (n = 1,2,3,...). 


But on the interval 0 < x < L/2, 


feven(z) = F(z} = ce 
Hence 
4d pl? 4d fx2}°? 
Aj=— dz = — |— == 
e =| — Fl, 2 
and 
L/2 
) (A) a (n = 1,2,3,...). 
L* Jo 


Using equation (33), we get 


i 8d i? a 2nrx ie 2nr7x 5 2nTrx oye 
Se | in 
L* \ 2n7r i iL L j 


= — (cos(nm) — cos(0)) 
ee ((=1)*=1) (Gb 4,2,3,.0;). 


nn? 


So 


Een) = 5 + ae ne 
n=1 


d 2d ((-1)” - 1) cos (722) 


Since f(x) and feven(x) coincide on the interval 0 < x < JL, this is the 
required cosine Fourier series F(x) for f(x). 


The first few terms in the Fourier series are 


d 4d 27x 1 67x 1 107ax 
F)=5-G COS “5. F ap 68 E. 7 eg es “i. = aaa 


This agrees with the result of Exercise 13 in the special case d= 1, L = 2. 


Solution to Exercise 18 
(a) The even periodic extension is given by 
1 forO0<t< oe 
=|. for. > <i S57; 
1 for =F <t< 40, 
al. If =e as, 
feven(t + 27) = feven(t), 


and is drawn below. 


deven (t) = 


The fundamental period of this even extension is T= 27, and its 
formula can be simplified to 


1 for —in< t< Tr, 
Sevealt) = 
fecoalt = 27) = Feven(t): 


(b) Because the function feyen(t) is even and has period rT = 27, its 
Fourier series takes the form 


Feven(t) = Ap + 5 An cos(nt). 


n=1 


1 3 
=l ior 7 << 5a, 


The coefficient Ap is given by 


D) T 1 m/2 T 
Ao = = | Feven(t) dt = — i ldt +f (=) dt )} = 0. 
27 0 as O m/2 


Solutions to exercises 


The average value of feyven Over 
its period is equal to zero. 
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The coefficients A, are given by 


4 7 
An = 5 / fies Oveoalesy de 


D) m/2 7 
- | cos(nt) dt — 7 cos(nt) dt 
wv 0 a/2 


me (omens? — fino] ,.) = Fesin () 


na 


When n is an even integer, sin(n7/2) = 0. When n is an odd integer, 


we can put n = 2m — 1 for m= 1,2,3,... and use equation (24) to get 
2m — 1 
sin () = sin (oe) = (-1)"+1, 
2 2 
Hence 


lee) _4\m+41 
‘ s —— cos((2m — 1)t). 


m=1 


Feven (t) = 


(c) The odd periodic extension is defined by 


1 for 0 <1 < §, 
=1 ford <t< 7, 
=I tor —F = 7 <0, 


I fort, 
foaa(t + 277) = foaa(t), 


foaalt) = 


Do not worry too much about and is drawn below. 


the precise placement of the 
open circles; you would not be 
penalised in assessments or the 
exam for getting this wrong. 
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Because of the way the discontinuities of this function are defined, it 
has fundamental period 7 = 27. 


(d) The graph of the odd extension is very similar to the following graph, 
except for the points of discontinuity. 


This function has fundamental period 7 and is defined by 


7 (i) = dor=S< t=, 
fo) t) = 
“ 1 for0<t<4, 


foaa(t + 7) = foaa(t). 


The Fourier series for this function was given in equation (27): 


'o=-). > - sin (2(2n ~1)t). 


Since Fourier series cannot distinguish between functions that differ at 
isolated points, this is also the required Fourier series for the odd 
extension foaa(t). 


Solution to Exercise 19 


(a) f(t) is discontinuous at t = 1. Just below t = 1, f(t) =1, and just 
above t = 1, f(t) = 0. Hence at ¢t = 1 the Fourier series converges to 


F(1) =. 
(b) We can compare this with the Fourier series derived in Example 8: 
1 wl — (-1)" 
F()=71 > Ga) ((—1)" — 1) cos(nat) — Me ey sin(nat). 


But at t = 1, sin(nat) = 0 and cos(nzt) = (—1)” for any integer n. So 


iL & i. 
Os = oe 


—1)(-1)”. 


4  “ (nr) 
So 
nw? ae | ‘ 
Fr ae! ) 
n=1 
2 2 2 
= ja got pat 
le 
23 (2n—1) 
Hence 
W = 1 
8 = 20 Gat) 
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Solution to Exercise 20 
The function f(x) is sketched below. 


This function has fundamental period 7 = 1 and is neither odd nor even, 
so its Fourier series takes the form 


f(z) = Ao + > A, cos(2n7x) + ? B, sin(2n72). 
p=1 n 
If we were to take the fundamental interval of this function to be 
—1/2 < x < 1/2, it would be in two pieces and we would have to perform 
two integrals for each Fourier coefficient. Instead, let us use 
equations (41)-(43) with t) = —} and r= 1. Then 


Ag = 1 Fe) dx 


a to 
1 3/4 
= al ean 
i 
3/4 
= 3 [2°] 14-2 (Ge — 6) = 7 
Similarly, 
to+ttT 
An = = | f(a) co (7=*) dx 
® Je s 


3/4 
= 2 | x cos(2n72) dx. 
-1/4 


Using the standard integral in equation (33), we get 


2, 
An = (Qnz)2 [cos(2nmx) + 2nrex sin(2n72) an 
2 


a (cos (nz) + 3nmsin (nz) 


(Qn)? 
cos ( int) | in sin (nn). 


2 
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When n is any integer, we have 

cos (—4n7) = cos (—3nm + 2nz) = cos (nz) 
and 

sin (—3nz) = sin (—in0 + 2nr) = sin (3nz) : 
So 


= I 3 = 
An = 7a on (3nz) (i= 152 Bs): 


Similarly, 


3/4 
= 2 | x sin(2n72) dx. 
—1/4 


Using the standard integral in equation (32), we get 


2 
i= nap [sin(2n7x) — 2nzz cos(2n72)| >, 


= Gna (sin (nm) — 3nmcos (3nz) 


sin ( $nT) $17 COs (nz). 


We use cos (—3n7) = cos (nz) and sin (—$n7) = sin (3n7) again to give 


1 
Bn = —7 60s (3nz) Ct = 15285200): 


Hence the Fourier series is given by 


Pa ‘ + > ~ (sin (2nz) cos (2nmx) — cos (2nz) sin (2nr2)) . 
n=1 


Solution to Exercise 21 


The function c(t) is continuous, as can be seen from its graph, and s‘(t) is 
minus its derivative. The Fourier series for s’(t) is denoted by S(t) and is 
equal to minus the derivative of C(t). Hence 


S(t) = -* » ea a # (cos(2nt)) 


<~ 4n? —1 dt 
4 (-1)""! 
=e d, iat (—2n sin(2nt)) 
4— 2n 
_ n+1 c 
=e ae yey Sin (2nt). 
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Solution to Exercise 22 


(a) f(t) has fundamental period 7 = 2. Hence from equations (48) 
and (49), the exponential Fourier series is given by 


fore) 
int 
) C,er™, 


n=—Cco 


with Fourier coefficients 


aL, f(t) eo innt dt 


= 1 [ ai 1 
2(a — int) =o 
1 ; : 
= (oom = 6), 
2(a — int) 
We have 
ela-int) _ e%e-inm — @@ (cos(nm) — isin(nm)) = (—1)"e%, 


and similarly, 


e7 (a-inn) = ete e-%. 
Hence 


_ (=1)" eh ag ® 
C, = ( ). 


2(a — int 
Multiplying by 1 = (a+ inm)/(a + inz), we get 
eUNe =e) 
C,= Mak prea) (a+ inz). 
The exponential Fourier series for f(t) is therefore 


Fi\= a So (a+ inn) e”™. 


n=—Cco 


(b) Using equations (51) and the expression for C,, calculated in part (a), 


we get 
Ag = Co = a 
Ay = 2Ra(0,,) = See 


The trigonometric Fourier series for f(t) is therefore given by 


F(t) = (e* —e-%) a + a (-)" 


————— _(acos(nzt) — nrsin(nat 
2a = a? + n27? ( ea) ( )) 
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Unit 12 


Partial differential equations 


Introduction 


A partial differential equation is an equation relating a dependent 
variable and two or more independent variables through partial derivatives 
of the dependent variable. An example is 


Ou | Ole _ ty) 

Ox? Oy? : 
in which the dependent variable u is a function u(x, y) of two independent 
variables, 7 and y. 


Differential equations have played a very important role in the module so 
far. But until now, all the differential equations that you have solved have 
had just one independent variable, and contained ordinary derivatives with 
respect to that independent variable. Such equations are often called 
ordinary differential equations when it is necessary to distinguish them 
from partial differential equations. For many of the systems that we want 
to model, ordinary differential equations are inadequate because the states 
of the system can be specified only in terms of two — or even more — 
independent variables. When we are trying to describe the way in which 
such a system changes, we are inevitably led to consider partial differential 
equations. 


Partial differential equations and fields 


Much of the third book of this module was concerned with scalar and 
vector fields. You will be familiar with the idea that a scalar field can 
describe how a quantity such as temperature varies throughout space, 
and that this field is described by a function — for example, 0(2, y, z, t) 
might be the temperature at position (x,y,z) and time t. But we 
always regarded the fields as ‘given’ quantities: we specified the 
functions describing the fields, without discussing how these functions 
can be obtained. 


In fact, the laws of nature that determine scalar and vector fields are 
often formulated as partial differential equations. This makes the 
study of partial differential equations a key skill for anyone who wants 
to understand physical sciences at a quantitative level. 


Having studied Units 1 and 2, you will appreciate that solving differential 
equations can be difficult, and that analytic solutions are not always 
available. It should be no surprise that partial differential equations are 
typically harder to solve. However, it turns out that many of the most 
important partial differential equations can be solved by the method of 
separation of variables, which is covered in this unit. 


This unit concentrates on two examples of partial differential equations, 
namely the wave equation and the diffusion equation. Both of these 
equations describe how a scalar quantity (u, say) varies in space and time. 


Introduction 


Partial derivatives were 
introduced in Unit 7. 


Ordinary differential equations 
are the subject of Units 2, 3, 6 


and 13. 


In this unit, temperature is 
denoted by the symbol 6. 
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We concentrate on the simplest situation, the one-dimensional case, where 
there is only one coordinate, x, for the space dependence, and time is 
represented by t. 


Wave equation and diffusion equation 


The one-dimensional form of the wave equation is 


1 Oo? 2 
gach ca (1) 
Co) ee 

where c is a positive constant called the wave speed. 


The one-dimensional diffusion equation is 
Ou Oru 
mn A (2) 
Ot Ox? 

where D is a positive constant called the diffusion coefficient. 


The diffusion equation is also known as the heat equation. The contexts 
in which these equations arise will be described later in the unit. 


Classification of partial differential equations 


There are systematic ways of classifying partial differential equations, 
based on the classification of ordinary differential equations. You do 
not need to remember the definitions, but you should be aware of the 
terminology because you may meet it in more advanced courses. 


e The order of a partial differential equation is the order of the 
highest derivative that occurs in it. 


e A partial differential equation is linear if all terms that contain 
the dependent variable are proportional to the dependent 
variable, or one of its partial derivatives, but not both. 


eA linear partial differential equation is homogeneous if there are 
no terms that are solely functions of the independent variables. 


In this unit we deal only with second-order linear homogeneous partial 
differential equations. From these definitions you can see that both 
the wave equation (1) and the diffusion equation (2) are examples. By 
contrast, the partial differential equation 


Ou Ou Ou 

nh cous 

Ot OL Of" 

is non-linear because of the term that is a product of u and 0u/0z, 


and inhomogeneous because the term sin(a +t) does not contain u. 
Equations of this type are beyond the scope of this unit. 


= sin(x + t) 


1 The method of separation of variables 


Study guide 


Section 1 introduces the wave equation and considers how it is used to 
describe the vibrations of a plucked guitar string. The wave equation is 
then solved using the method of separation of variables. This very 
important technique has two main stages. First, we find a set of simple 
solutions that satisfy the partial differential equation and its boundary 
conditions. Then we find a linear combination of these simple solutions 
that satisfies the partial differential equation, its boundary conditions and 
the given initial conditions. The task of finding the appropriate linear 
combination in this case makes use of the Fourier methods covered in 
Unit 11. 


Section 2 introduces the diffusion equation, which can be used to model 
the slow spread of materials, such as the slow spread of a pollutant as it 
contaminates groundwater. Most of this section is concerned with 
arguments that justify the form of the diffusion equation. You will not be 
asked to reproduce these arguments in assignments or in the exam. 
However, because of the importance of partial differential equations in the 
physical sciences, it is valuable to see one example of a partial differential 
equation being derived. The section ends by illustrating the solution of the 
diffusion equation, again using the method of separation of variables 


As well as describing the spread of materials, the diffusion equation also 
describes the spread of heat. In this context, the diffusion equation is 
known as the heat equation. The heat equation and some of its solutions 
are considered in Section 3. 


All the solutions considered in Sections 1 to 3 are for cases where the 
equations describe systems with boundaries. The wave equation and 
diffusion equation also apply to systems without boundaries, and in these 
cases useful solutions are available that are not easily obtained by the 
method of separation of variables. We discuss some useful alternative 
forms of solution of the wave and diffusion equations in Section 4. 
However, this section is optional reading. 


1 The method of separation of 
variables 


The most important idea that you will learn from this unit is the method 
of separation of variables for solving linear homogeneous partial differential 
equations. The wave equation can describe the motion of a plucked string, 
and we use this as our first example of a partial differential equation that 
is solved by the method of separation of variables. 
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Figure 3. A point ona 
vibrating string moves up 
and down 
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1.1 Motion of a plucked guitar string 


When asked to imagine a wave, you might think of an ocean wave rolling 
onto a beach (Figure 1(a)). This type of wave is called a travelling wave. 
But the wave equation can also describe a disturbance that varies in space, 
and oscillates at each point, but does not move through space. The motion 
of a guitar string is a good example (Figure 1(b)). 


Figure 1 ‘Two waves: (a) a travelling wave in the ocean; (b) a standing 
wave on a guitar string 


Figure 2 shows a possible motion for such a string. Each coloured curve 
indicates the shape of the string at a particular instant in time. The dark 
blue curve corresponds to the earliest time; the green curve to a slightly 
later time, and so on. The string vibrates ‘on the spot’, but no wave flows 
to the left or right, and there are some points (known as nodes) where the 
string remains permanently at rest. Motion such as this is called a 
standing wave. 


Figure 2. Shapes of a plucked guitar string at a succession of 
equally-spaced times: the time sequence corresponds to dark blue, green, 
cyan, black, magenta, orange, red, orange, magenta, black, cyan, green, 
dark blue, and so on 


Let us consider the motion of a plucked guitar string in more detail. In its 
equilibrium state, the string is taut and is anchored at two fixed points 
separated by a distance L. We take the string to lie along the z-axis, with 
one end at x = 0 and the other at « = L. The motion of the string is 
confined to a plane, which may be taken to be the xy-plane. The motion of 
each point of the string is assumed to be up and down (or transverse) — 
that is, parallel to the y-axis, with no motion along the z-axis (Figure 3). 
The transverse displacement of any point on the string is denoted u. The 
value of u depends on the position x of the point along the string, and also 
on time t. So we have two independent variables, x and t, and one 


1 The method of separation of variables 


dependent variable, u. We say that u is a function of x and t, and write 
= WZ, t), 


At a fixed time ¢ = t, the function u(x, t,) is a function of x alone; this 
describes the shape of the string at the given time ¢,. For a given point on 
the string, labelled by x = 21, the function u(2,t) is a function of t alone; 
this describes the motion of the given point on the string as time 
progresses. Figure 4 illustrates both these aspects. Figure 4(a) is a typical 
graph of u(az,t,) against x, giving a snapshot of the shape of the string, 
while Figure 4(b) is a typical graph of u(x,t) against t, showing the 
displacement of a single point on the string as a function of time. 


WA 


Sy 


chy 


(b) x fixed (at x1), varying t 


Figure 4 Graphs of: (a) u(a,t,) against x, showing the shape of the 
string at time t,; (b) u(x1,t) against t, showing the displacement of a 
single point on the string as a function of time 


In order to describe the motion of the string, we need to find the function 
u(x,t). Since u depends on both x and t, an equation that models the 
motion of the string is expected to involve partial derivatives of u with 
respect to both x and t. The appropriate differential equation for small 
vibrations of a flexible taut string is the wave equation 


Oru i Oru 

Ba? 2 OB” ) 
where c is a constant whose value depends on various physical In fact, c depends on the linear 
characteristics of the string. This constant is called the wave speed, density and tension of the string. 


although the reason for this name will become apparent only at the end of 
this unit. The quantity 0?u/0t? on the right-hand side of equation (3) is 
the acceleration of a tiny segment of the string. A lengthy analysis shows 
that the net force acting on this segment is proportional to 0?u/0z?. 
Equation (3) therefore embodies Newton’s second law: force is 
proportional to acceleration. The derivation of the wave equation is not 
part of this unit. 
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It is easy to check whether or not a function is a solution of a partial 
differential equation by simply substituting the given function into the 
given equation, and seeing whether the equation is satisfied. The only 
difference from the case of an ordinary differential equation is that you 
have to calculate all the relevant partial derivatives. For example, let us 
check that 


u(x,t) = sin(kx) cos(kct) 


is a solution of the wave equation (3) for any constant k. We have 


Ou Ou 

= — = ~—kesi in(ket 

Wn kcos(ka:) cos(kct), ey kesin(ka) sin(kct), 

Oru — Oru ee 

Oru oe t). 

a2 k* sin(kax) cos(kct), FP k*c* sin(kax) cos(kct) 
So when u(x,t) = sin(kx) cos(kct), 

au 1 oy 

On? 2 Or” 


and this function is indeed a solution of the wave equation. 


Exercise 1 


Determine whether u(x,t) = Asin(kx) sin(kct), where A and k are real 
constants, is a solution of the wave equation. 


Exercise 2 


If the displacement of the string is u(x,t) = Asin(kx) sin(kct), find 
expressions for the displacement and velocity of the string at position x 
and time t = 0. (Hint: The velocity at time t is the partial derivative of 
the displacement with respect to time t.) 


Boundary conditions and initial conditions 


Just giving a partial differential equation is never enough to specify a 
problem completely: some additional information in the form of boundary 
Initial conditions and boundary —_ conditions and/or initial conditions is always required. The boundary 
conditions were discussed in conditions and initial conditions appropriate to obtaining a particular 
Unit 3. solution depend on the context. For example, for the wave equation as a 
model of the vibrations of a guitar string, we need two boundary 
conditions and two initial conditions. 


If the string is anchored at « = 0 and « = LF, and we are interested in the 
motion following the string’s release at t = 0, then the boundary conditions 
are 


v0c) =u =0, 20, (4) 


corresponding to the string being fixed at its ends. 
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The initial conditions model the action of releasing the string and setting 
it in motion. In particular, plucking consists of holding the string in a 
certain shape, at rest, and then releasing it. If the initial shape of the 
string is given by a function f(a), then the initial conditions for a plucked 
string may be specified in the form 


and 
“eit 02es5 6 
Faun ) ee) STS4. ( ) 


The first initial condition describes the initial shape of the string, while the 
second corresponds to it being at rest initially. Note that for a partial 
differential equation, the initial condition is described by a function f(x), 
whereas in the case of an ordinary differential equation an initial condition 
is described by a number. The initial conditions are often specified 
piecewise, as in the following example and exercise. 


Example 1 


A taut string of equilibrium length L is plucked at its midpoint, which is 
given an initial displacement d, as shown in Figure 5. The string is then 
released from rest. Write down the initial conditions for the wave equation 
describing transverse vibrations of this string. 


Solution 


The displacement shown in Figure 5 has two linear sections. The left-hand 
section has slope d/(L/2) = 2d/L and has the value u = 0 at x = 0. It is 
described by the function u(x) = (2d/L)x. The right-hand section has 
slope —2d/L and has the value u = 0 at x = L. It is described by a linear 
function of the form 


2 
u(x) = 2, +C, 


where C is a constant. Setting u(L) = 0 gives C = 2d, so the right-hand 
section is described by the function 


2d 2d 
= 2d —- —x = —(L—- 
u(a) = 2d - So = 2(L—a) 
Hence the initial displacement is given by the piecewise function 
2d 
—w2 forO<a< sL, 


ule,0) = bd 
7 (E-2) for 5L <a <L. 


Because the string is released from rest, the transverse component of the 
initial velocity is given by 
Ou 


ay (i0) =0, OSHS L. 


Figure 5 String plucked at 
its midpoint 


Both parts of this expression 
give u(x,0) =dat «= L/2. 
This is a useful check. 
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Figure 6 String plucked at a 
distance L/3 from x = 0 


The method described here is 
not the same as the separation 
of variables method in Unit 2, 
which applies to first-order 
ordinary differential equations. 
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Exercise 3 


A taut string of equilibrium length L is plucked at a point one-third of the 
way along its length, which is given an initial displacement d, as shown in 
Figure 6. What are the initial conditions for the wave equation describing 
transverse vibrations of this string? 


We have seen that any function of the form u(x,t) = sin(kx) cos(kct) is a 
solution of the wave equation, for any constant k. In particular, for 
b=a/ 1; 


u(e,t) = sin (=) cos (=) (7) 


is a solution of the wave equation for transverse vibrations of a taut string, 
where L is the equilibrium length of the string. This solution also satisfies 
the boundary conditions (4) and the initial condition Ou(x,0)/Ot = 0. It 
describes a special case where the initial displacement of the string is a 
sinusoidal function, that is, the function f(a) in (5) is f(x) = sin(ma/L). 


Exercise 4 


Show that the solution given by equation (7) satisfies the boundary 
conditions 


u(0,t) =u(L,t)=0, t>0, 


and the initial condition 


a 
5p (#0) = 0. O<a<L. 


Boundary conditions, initial conditions and uniqueness 


In general, it may not be clear which boundary and initial conditions 
are required to go with a given partial differential equation. When 
solving practical problems, the boundary and initial conditions should 
contain enough information to determine a unique solution of the 
partial differential equation. There are mathematical conditions for 
determining when there is a unique solution. In practice, however, 
these are rarely used. Usually an understanding of the physics or 
engineering context is a reliable guide to what sort of initial and 
boundary conditions are required. 


1.2 Separation of variables for the wave equation 


We have already said that the most important idea that you will learn 
from this unit is the method of separation of variables. We now apply this 
method to the wave equation for vibrations of a taut flexible string. 


1 The method of separation of variables 


The method has a number of stages. First, we find some special solutions 
of the wave equation that satisfy the given boundary conditions. Then we 
show that linear combinations of these special solutions also satisfy the 
wave equation. The final stage of the calculation selects the particular 
linear combination that is needed to ensure that the initial conditions are 
met. In this subsection, we concentrate on the first stage — finding a set of 
special solutions of the wave equation from which everything else will be 
constructed. We require the solutions to satisfy the boundary conditions, 
but we will not bother with any particular initial conditions at this stage. 


The partial differential equation that we wish to solve is the wave equation Sections 2 and 3 will apply the 


for vibrations of a taut string: same method to the diffusion 
é P equation (also called the heat 
Ou 1 Ou (8) equation). 
da2 2 Ot?’ 
subject to the boundary conditions 
u(O0,t) =u(L,t) =0,. > 0: (9) 


The first step in the method of separation of variables is to look for 
solutions of (8) and (9) in the form 


ui ost) = X (x) T(E), (10) 


where X (x) is a function of x alone, and T(t) is a function of t alone, so 
that the variables x and t occur in two separate functions. Note that we 
are not claiming that all the solutions of equation (8) are of this form. We 
are merely restricting attention to a simple type of solution, in which 
u(x,t) happens to be the product of a function of x and a function of t. 
Such solutions are called product solutions. 


We now prepare to substitute equation (10) into the wave equation. The 
partial derivative 0/Ox, with respect to x, acts only on the function X (zx), 
and 0/Ot acts only on T(t). Because X (a) and T(t) are both functions of a 
single variable, their derivatives are written with upright, rather than 
curly, dees. We therefore have 


Ou dX Ou _ x dT 

Oa dx’ Ot ~~ dt’ 
Differentiating again gives 

O-u d?@X Oru er 


dx2 da®~’ Of  ~ dt?’ 
Substituting these second-order partial derivatives into the wave equation 
then leads to 
ox ior 
T+ = 5X -. 11 
dee ede a) 
The secrets of this equation can be unlocked by dividing both sides by the 
product X(ax) T(t). This gives We assume that X(x) and T(t) 
9 9 are non-zero (except possibly at 
* aes = a aT isolated points). 
Ade? fT dv? 
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Now, this equation has a very interesting property. Because the function 
T(t) does not appear on the left-hand side, the expression to the left of the 
equals sign is a function of x only, and does not depend on t. Similarly, the 
right-hand side is a function of t only, and does not depend on x. But since 
these expressions are equal, neither expression can depend on either x or t. 
That means that both sides of the equation are equal to the same 
constant, which we call uw. We can therefore write 


1 dx CLar 
X de" 2T ae 
So equation (11) has yielded two ordinary differential equations: 
1 ax Li? 
X de % O° QT ae 
Multiplying the first equation by X(a) and the second by T(t) gives 


ox 

ae wx (12) 
and 

ar 


These ordinary differential equations for X(x) and T(t) must be satisfied 
in order for the product function X (x) T(t) to be a solution of the wave 
equation (8). Conversely, the wave equation is satisfied by X (x) T(t) if 

X (x) satisfies equation (12) and T(t) satisfies equation (13). The constant 
i is called the separation constant. We have no information about this 
constant at this stage, but we can say that the same constant appears in 
both equation (12) and equation (13). 


The ordinary differential equations (12) and (13) are linear and 
homogeneous, and they can both be solved using the methods of Unit 3. 
The nature of the solutions depends on the value of the separation 
constant 44, and we will consider three cases in turn, depending on whether 
L is positive, negative or equal to zero. In each case we will determine the 
form of the solutions of equations (12) and (13), and consider whether 
these solutions can satisfy the given boundary conditions. 


Separation constant positive 


If « > 0, we can write = k?, where k is a real positive constant. Then 
equation (12) can be solved by substituting in the trial solution 

X(a) = exp (Ax). This leads to the auxiliary equation \? = p = k?, so 
A = +k and the general solution is 


X (x) = Aexp(kx) + Bexp(—kz), (14) 


where A and B are arbitrary constants. 


We could easily determine the solution for T(t) using the same approach. 
We will not do this because the form of T(t) is irrelevant for our purposes. 
We need to know only that the product function takes the form X(x) T(t), 
where X (x) is given by equation (14). 


1 The method of separation of variables 


Having determined the form of the solution, we now consider whether the 
boundary conditions can be satisfied. The displacement 

u(a,t) = X(x) T(t) must be zero at both ends of the string ( = 0 and 

x = L) for all positive values of t. This implies that the function X(z) 
must satisfy the boundary conditions 


X(0) = X(L)=0. (15) 


We consider the conditions X(0) = 0 and X(L) = 
function X (a) in equation (14), the condition X (0 


A+B=0, 
and the condition X(L) = 0 gives 
Aexp(kL) + Bexp(—kL) = 0. 


0 in turn. For the 
) = 0 gives 


Combining these equations gives 
A(exp(kL) — exp(—kL)) =0. 


Since both k and L are positive, kL > 0, and the only way of satisfying For kL > 0, exp(kL) > 1 and 
this equation is to take A = 0. This gives u(x,t) = 0, which does solve the exp(—kL) < 1. 

partial differential equation, but in a very dull way. It corresponds to a 

string that remains permanently in its equilibrium state, not vibrating at 

all. Such a solution is often referred to as a trivial solution, and is not 

the solution we are seeking. 


Separation constant negative 


If uw <0, we can write pp = —k?, where k is a real positive constant. Then 
equations (12) and (13) become 
d?xX 
~* = —k?x 16 
dx? : (16) 
CT 8 


Again, we concentrate on the first of these equations. This can be 
recognised as the ‘equation of simple harmonic motion’ discussed in Unit 8, 
and it has the general solution 


X(x) = Ccos(kx) + Dsin(ka), (18) 


where C and D are arbitrary constants. Let us see whether this function 
can satisfy the given boundary conditions (15). Applying the condition 
X(0) = 0 to the function in equation (18) gives C = 0, so the solution 
becomes 


A(z) = Dsin( ke). 
The condition X(L) = 0 then requires that either D = 0 or sin(kL) = 0. 
The first possibility corresponds to the trivial solution u(x,t) = 0 


mentioned earlier. The second possibility is more interesting. It is satisfied 
if, and only if, & takes one of the special set of values 


nt : . 
kk = —, where n is an integer, 


L 
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and this gives a set of solutions 
NTT 
x(e)= Din ) 
(a) sin | — 


In fact, the values of n can be restricted further. The value n = 0 can be 
omitted because it gives the trivial solution u(x,t) = 0. Also, all negative 
values of n can be omitted because changing the sign of n is equivalent to 
changing the sign of D, which is an arbitrary constant anyway. We can 
therefore say that the most general solution of equation (16), consistent 
with the boundary conditions, is 


X (xz) = Dsin (=) , where n = 1,2,3,.... 
We will return to consider the corresponding solution for T(t) shortly. 


Separation constant equal to zero 


If 4 = 0, the equation for X (x) is 


dx 
— = 0. 
dx? 
The solution of this equation is 
X(z) = Fx+G, 


where F’ and G are arbitrary constants. The boundary condition X(0) = 0 
gives G = 0, so the solution becomes X(x) = F'x. The boundary condition 
X(L) = 0 then gives F = 0. So F = G =0, and the only solution 
consistent with the boundary conditions is the trivial solution u(x,t) = 0. 


Review 


Let us review what has been done. We looked for special solutions of the 
wave equation that are product functions of the form X(x) T(t). We then 
saw that the functions X (a) and T(t) must obey the ordinary differential 
equations (12) and (13), which both involve the same separation 
constant [J. 


We then considered whether the solutions of equation (12) can satisfy the 
boundary conditions (15). Assuming that py is a positive constant, or zero, 
gave functions that do not obey the boundary conditions, or are trivial and 
of no interest. However, trying a negative value of the separation constant 
(writing . = —k?, where k is a positive constant) gave a set of non-trivial 
solutions that do obey the boundary conditions. Whenever you try a 
solution by separation of variables, you need to check what happens for 
both signs of the separation constant (and you usually need to consider 

jt = 0 separately as well); you cannot anticipate which choices will give 
useful solutions. 


In order for the wave equation, with its associated boundary conditions, to 
have a non-trivial product solution X (a) T(t), the separation constant ju 
must be negative. The allowed negative values of are not arbitrary. 


1 The method of separation of variables 


Writing » = —k?, where k is a real positive constant, we have seen that the 
allowed values of k are 


hn = for n = 1,2,3,..., 


so the allowed values of the separation constant ju are 


(2 
Pn = kn = (19) 
Corresponding to each of these values, there is a solution for X (x): 
X,(z) = Dsin (=) (20) 


We now consider the functions T(t). The same separation constant occurs 
in the differential equations for X(a#) and T(t), so if we are looking for the 
function T(t) that accompanies the solution X,,(xz) in equation (20), we 


must use the value u,, = —k2 in the differential equation for T(t). Hence 
equation (17) takes the form 

gt 

TE = ke T,,. 


This has general solution 


T(t) = acos(k,ct) + 8 sin(k,ct) 


t t 
= acos (= ) + Bsin (= ) ; (21) 


where a and £ are arbitrary constants. 


To obtain the possible product functions u,(x,t) = Xn(x) T(t), it only 
remains to multiply together the expressions in equations (20) and (21). 
We combine the constants by writing A, = aD and B, = GD. The 
resulting solution is then 


; t t 
ty (2,4) = sin (=) La, cos & ) + B, sin & )| ; (22) 


where A, and B, are arbitrary constants and n = 1, 2,3,.... 


Equation (22) gives a whole family of solutions, each member of which 
satisfies the wave equation (8) and its boundary conditions (9). The 
arbitrary constants A, and B, need not be the same for different members 
of this family, so it is appropriate that they are labelled by the subscript n. 


The initial displacement of the string for the product solution u,,(z, t) is 
found by substituting t = 0 in equation (22). This gives 


—). (23) 


tin @,0) = An sin (= 
The initial displacements for the first three solutions in family (22) are 
shown in Figure 7 (taking A, = 1). These are the initial shapes of the 
string. Of course, these shapes are rather special, and do not correspond to 
the actions of any guitar player! 


The function in equation (7) is a 


member of this family with 
m= 1, A, =l and B,; = 0. 
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Also, the functions T,,(t) in 
equation (21) are eigenfunctions 
of differential equation (13). 
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Figure 7 Initial displacements at t = 0 for the first three solutions in the 
family (22), taking A; = Ag = Az = 1 


Once the string is released, its motion obeys equation (22). The term in 
square brackets scales the shape described by sin(nax/L) by a factor that 
oscillates sinusoidally in time. The motion is that of a standing wave — a 
wave that oscillates without travelling through space. For example, if 
sin(nrz/L) = 0 at a particular point, then the disturbance will always be 
equal to zero at that point; this corresponds to the fact that the nodes of 
the standing wave remain fixed in space. Each solution in the family (22) 
has a definite angular frequency w, = nac/L. As n increases, wy, increases, 
corresponding to a higher frequency of oscillation of the string. 


Eigenvalues and eigenfunctions 


In looking for solutions of the wave equation in the form X(x) T(t), 
we were led to consider the ordinary differential equation 
2 

as = pX, (Eq. 12) 
with boundary conditions X(0) = X(L) = 0. It is a remarkable fact 
that this equation has acceptable solutions (satisfying the boundary 
conditions) only for certain values of jz, namely 

nen 


Ln = oe i = Il, Bo Byos ac 


Corresponding to each of these allowed values, there is a solution 
Xin (=) >» WH I1,AB.coo 


The special values y,, that allow a solution are called eigenvalues, 
and the corresponding solutions X,,(z) are called eigenfunctions. 


When each solution X,,(x) is joined to its partner T,,(t), we get a 
solution to the wave equation with a sinusoidal time dependence 
characterised by a definite angular frequency w, = nac/L. 


1 The method of separation of variables 


Matrices, normal modes and quantum mechanics 


There are strong analogies with concepts met earlier in the module, 
and important applications to science and engineering. 


e =6©Recall that a matrix equation of the form 
PASEO, 


where A is a given square matrix, x is a column matrix, and A is 
a number, is called an eigenvalue equation. The values of that 
allow solutions to be found for x are called eigenvalues, and the 
corresponding solutions x are called eigenvectors. Equation (12) 
is analogous to this, but instead of a matrix A acting on a 
vector x, we have a differential operator d?/dx? (supplemented 
by boundary conditions) acting on a function X(z). 


e Unit 6 discussed the oscillations of systems of particles, such as 
the atoms in a carbon dioxide molecule. You saw that there are 
some characteristic patterns of displacement that oscillate with 
definite angular frequencies. These patterns are called normal 
modes. They exist only at a discrete set of angular frequencies, 
which are determined by finding the eigenvalues of a matrix. The 
standing waves on a string are so reminiscent of this that they 
too are referred to as normal modes. 


e In quantum mechanics, there is a partial differential equation 
called the Schrddinger equation. This is not the same as the wave 
equation for a string, but there are similarities. The Schrodinger 
equation can be solved for a hydrogen atom, using the method of 
separation of variables, much as we have done here. Again, there 
are eigenvalues and eigenfunctions: these are interpreted, 
respectively, as the allowed energies and the corresponding states 
of the atom. Because the eigenvalues form a discrete set, the 
atom has a discrete set of allowed energies. This is known as the 
quantisation of energy. 


Exercise 5 


Apply the method of separation of variables to the partial differential 
equation 

Pu dtu 

ae Ox" 
which occurs in the theory of bending elastic rods. Write 
u(x,t) = X(x) T(t), and establish ordinary differential equations for the 
functions X(#) and T(t). Do not attempt to solve these equations. 


97 


Unit 12 Partial differential equations 


98 


Exercise 6 


Apply the method of separation of variables to the partial differential 
equation 

Ou Oo ru 

OL = 9g e) oe Aye’ 
which occurs in the theory of diffusion of solid particles in a fluid. Write 
u(x,t) = X(x) T(t), and establish ordinary differential equations for the 
functions X(a#) and T(t). Do not attempt to solve these equations. 


1.3 Superposition and the general solution 


So far, we have found a family of solutions of the wave equation (8) that 
satisfy the boundary conditions (9). These solutions, specified in 
equation (22), are all of the product form X(ax) T(t). You might ask why 
we decided to look for solutions like this. The reason is not very profound 
— it is just that these solutions are found relatively easily (provided that 
the method of separation of variables works at all). 


However, we cannot pretend that every solution is a product solution. For 
example, equation (23) and Figure 7 show that the product solutions are 
produced by very special initial conditions at t = 0. When a guitar string 
is plucked at its midpoint, as in Figure 5, the initial conditions are quite 
different, and the subsequent motion of the string cannot be described by a 
product solution. 


Fortunately, there is a way ahead. The wave equation is linear, and so are 
all the partial differential equations in this unit, which means that the 
principle of superposition applies. In the specific context of linear 
second-order partial differential equations, the principle of 
superposition states that if u;(2,t) and u2(z,t) are solutions of the 
equation, then any function of the form 


u(x,t) = aj ui (x,t) + a2 ua(z, t), (24) 
where a; and ag are constants, is also a solution of the equation. 


The following exercise asks you to verify that this principle applies to the 
wave equation, and to show how it applies in the presence of the usual 
boundary conditions. 


Exercise 7 

Suppose that the functions u(2,t) and u2(a,t) satisfy the wave equation 
Pu 1 Pu 
Ox2 ce? OR?” 

together with the boundary conditions for fixed ends 


u(0,¢) =u(L,t) =0. 


1 The method of separation of variables 


Show that the linear combination u = ayu, + agu2, where a; and ag are 
any constants, is a solution of the same partial differential equation and 
satisfies the same boundary conditions. 


The principle of superposition takes two solutions and generates a third. 
Repeating this process, we can add further solutions and expand the linear 
combination without limit, generating many more solutions. Moreover, if 
all the individual solutions satisfy the boundary conditions u(0,t) = 0 and 
u(L,t) = 0, then so does the linear combination formed from them. 


Starting from the product solutions in equation (22), it follows that any 
linear combination of the form 


u(a,t) = > sin (=) La, cos (=) + By sin (=) ' (25) 


where A, and B, are constants, is a solution of the wave equation that 
satisfies the boundary conditions for fixed ends, u(0,t) = 0 and u(L,t) = 0. 


The sum in equation (25) may stop after a finite number of terms; this 
happens if all the A, and B, are equal to zero beyond a certain value of n. 
However, it is also possible that the sum continues without ever ending. 
The value of such an infinite sum is defined as the limiting value of the 
sum of the first N terms, as N tends to infinity. However, this technicality 
is really beyond the scope of this unit. We assume that sums of this type 
are ‘well-behaved’ so that there is no difficulty, for example, in 
differentiating u(x,t) by differentiating each term in the infinite series. 


The principle of superposition greatly extends the range of known 
solutions. In fact, it delivers something even more powerful. It turns out 
that for a string that is anchored at « = 0 and x = L, every solution can 
be written in the form (25). In other words, equation (25) is the general 
solution of the wave equation subject to these conditions. 


General solution for motion of a string 


The general solution of the wave equation on the interval from 0 to LD 
with boundary conditions u(0,t) = u(L,t) = 0 is 


u(z,t) = Ss sin (=) La, cos (=) +B, sin (=*)| , (26) 


where A, and B, are arbitrary constants. 


This is a wonderful gift. We started with a restricted family of solutions — 
the product solutions. These are just a small subset of all the possible 
solutions, but it turns out that any solution can be expressed as a linear 
combination of them. We do not prove this fact, but we can say that it is a 
common feature of many linear partial differential equations. 
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For different partial differential equations, the functions that emerge from 

the method of separation of variables are not always sines and cosines, but 
they often provide a set of functions that is broad enough for any solution 

to be expressed as a linear combination of them. Such a family of functions 
is sometimes said to form a complete set for the problem at hand. 


1.4 Initial conditions and Fourier series 


The constants A;, Ag, A3,... and B,, By, B3,... in the general solution are 
determined by the initial conditions. 


An important case is that of a plucked string, released from rest at t = 0, 
with an initial displacement specified by a function f(x). These initial 
conditions are described by the equations 


oH (0,0) =, ue) = 78), 028<h (27) 


Consider the first condition, which describes release from rest. 
Differentiating both sides of equation (26) with respect to t, and assuming 
that the derivative of the right-hand side is obtained by differentiating 
each term in the sum, we get 


) . t t 
HT = a (=) (=) [-A, sin (= ) + By cos (= )| ; 


Setting Ou/Ot = 0 at t = 0 then gives 


0= y (™) B, sin (=) (28) 


One way of satisfying this equation is to take B, = 0 for all n. In fact, the 
right-hand side of equation (28) is a Fourier series with Fourier coefficients 
nicB,,/L. These Fourier coefficients are uniquely defined by the zero 
function on the left-hand side, and are all equal to zero, so the only way of 
satisfying equation (28) is to take B, = 0 for all n. The general solution 
given in equation (26) then reduces to the following expression. 


The general solution for a plucked string released from rest is 


TCE = Ap sin (=) cos (=) : (29) 


We must now choose the constants A,, so that the other initial condition is 
satisfied, namely u(x,0) = f(a), where f(a) describes the displacement of 
the string at time t = 0. 


Putting ¢ = 0 in equation (29), and using u(x,0) = f(x), we get 


fiz) = we sin (=) (0< «=< Li. (30) 
n=1 


1 The method of separation of variables 


The sum on the right-hand side is a Fourier series for the function f(x) 
that involves sine terms only. At first sight this may seem rather strange 
because f(x) is not a periodic function, but is defined only over the finite 
interval 0 < 2 < L. However, you saw in Unit 11 that a function defined 
over a finite interval can be extended outside this interval to give a 
periodic function. 


Because equation (30) involves sine terms only, we need the odd periodic 
extension here. Note that this choice is determined by the form of 
equation (30). There is no essential connection between the names used for 
the coefficients in this equation and the traditional names Ag, A, and B, 
used in the Fourier series of Unit 11. 


To take a definite case, suppose that the string is released from rest by 
being plucked at its midpoint, which has an initial displacement d. You 
saw in Example 1 that this initial displacement is described by the 
piecewise function 


f(@) = 


7 (E-2) for 4L <a < L, 


and a diagram of this initial displacement is reproduced in Figure 8. 


We can extend f(x) to give the periodic function foqq(z) shown in Figure 8 String plucked at 
Figure 9, which is given by the formula its midpoint 


7 fiz) for0<2< J, 
foaate) ={ 41) for —-L<2<0Q, 


Jodd(@ +2L) = foaa(a): 


feade) { 


Figure 9 The odd periodic extension of the function in Figure 8 


This is the odd periodic extension of f(x), and it has fundamental 
period 2L. Because the functions f(x) and foaa(x) are identical in the 
region of interest 0 < a < L, the constants A, required in equation (30) 
are identical to the Fourier coefficients of foaa(x). Since foaa(x) is an odd 
function with period 2L, we have 
L 
An = a i foadl a ) sin. (=) dx. See Unit 11, equation (37) with 
2L Jo L suitably adjusted notation. 
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Finally, the functions f(x) and foqq(x) are identical throughout the 
interval 0 < « < L, so we have the following result. 


yy fee . (nTx 
An= =f f(a) sin (“*) de, P= 1 oe. (32) 


To illustrate the use of a periodic extension, we have looked at the function 
illustrated in Figures 8 and 9, but it is clear that the same argument would 
work for any initial displacement. Hence equation (32) gives a general 
formula for the coefficients A, in equations (29) and (30) — we just have to 
insert the function f(x) that describes the initial displacement of the 
plucked string, as it is released from rest. 


For the initial displacement in equation (31) and Figure 8, the Fourier 
coefficients are 


Ad L/2 _ (nTrx - _ (NTx 
el vsin(") de f(b —a)sin (™) ae ; 


As is often the way, the Fourier integrals are messy to evaluate. There is 
nothing really difficult, but patience and care are essential. Fortunately, we 
have already calculated these integrals in Example 11 of Unit 11, so we can 
just quote the result. In this case, the Fourier coefficients are given by 


8d. nt 
An = =3-38in(F), 
so the values of the first few coefficients are 


8d 8d 8d 
aa ’ 2 0, 3 On2 ; 4 0, 5 2572 


Substituting these coefficients into equation (29), we conclude that the 
displacement of the plucked string at any time t > 0 is 


_ 8d). (me wet 1. 30x 37ct 
a et) = =) sin (=) cos ae eS sin as cos os 
A 51x 5act 
+5, om (==) cos (=) al (33) 


The exact solution is given by an infinite sum of terms, but a very good 
approximation is obtained by adding the first 30 terms on a computer. 
When this is done, the shape of the string is predicted to vary as shown in 
Figure 10. You may find this prediction surprising, especially the kinks 
that exist throughout the motion of the string. But if one films the motion 
of a real string that is released in the way assumed, the film captures a 
succession of images that match Figure 10 almost exactly! 


A 


1 The method of separation of variables 


Ula. t) 


ty 
QV 


Figure 10 The motion predicted by equation (33), with the time 
sequence red, dark blue, green, cyan, magenta, orange, magenta, etc.; this 
shows the displacements at a sequence of times 


Alternative initial conditions 


The general solution in equation (26) can be adapted to deal with the case 
where the initial conditions are 


ul 2,0) =O; e400) =e), Use Ly (34) 


that is, where the initial displacement of the string is zero, but the initial 
velocity is given by a function v(x). This corresponds more closely to a 
piano string that is struck by one of the piano’s hammers than to a guitar 
string that is plucked and released from rest. 


Because the coefficients A, in equation (26) are Fourier coefficients of the 
initial displacement, which is equal to zero for all x, we must have A, = 0 


for all n = 1,2,.... The general solution for the motion of the string can 
then be written in the form 
(oe) 
t 
u(z,t) = Bn sin (=) sin (= ) (35) 
n= 
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The coefficients B, can be determined by an approach similar to that used 
for the initially stationary string, as the following exercise shows. 


Exercise 8 


Consider a string, clamped at x = 0 and at x = L, with a displacement 
u(a,t) that satisfies the wave equation, with boundary conditions 
w0,¢) = wh, t) = 0 for? 0. 


At t = 0, the displacement is zero, so u(xz,0) = 0. However, the string is 
set in motion so that its initial velocity at x is v(a), where v(x) is a 
specified function. The odd periodic extension of v(x) has Fourier 
coefficients C’,, so for 0 < « < L the initial velocity of the string is given by 


ve) = ye sin (=) ; 


Use equation (35) to express the coefficients B, in terms of the Fourier 
coefficients C’,. 


The methods used in this section can be applied to a variety of linear 
homogeneous partial differential equations, not just the wave equation. 
The general method is summarised in the following procedure, which can 
be used for all the partial differential methods in this unit. 


Procedure 1 The method of separation of variables 


Given a linear homogeneous partial differential equation with 
dependent variable wu and independent variables x and t, subject to 
given boundary and initial conditions, a solution can often be found 
by the following steps. 


1. Write the unknown function u(2,t) as a product of functions of 
one variable: 


ret eae eines 


Find the required partial derivatives of u in terms of the ordinary 
derivatives of the functions X and T. 


2. Substitute the partial derivatives found in Step 1 into the partial 
differential equation. Rearrange the equation so that each side 
consists of a function of a single independent variable. Equate 
each side of the rearranged equation to the same separation 
constant 44, and hence obtain ordinary differential equations for 
Xx eine! WT. 


3. Use the given boundary conditions for u to find boundary 
conditions for X. 


4. Solve the differential equation for X, and apply the boundary 
conditions. Consider different choices for the separation 
constant py. (Typically, the solutions X (a) take a different form 
depending on whether the separation constant is positive, 
negative or zero.) The boundary conditions generally produce a 
discrete set of solutions X,,(z) and a corresponding discrete set of 
values j1,, for the separation constant. 


5. For each allowed yu,,, determine the corresponding solution T,,(t) 
of the differential equation for T(t). 


6. Combine X,,(x) and T,,(t) to obtain a family of product solutions 
ee Ce) tb) eo ere 


Express the general solution as an infinite linear combination of 
these product solutions containing a set of coefficients. For 
example, 


HG) = SS Cp Un anele 
i=l 


7. Use the initial conditions and results about Fourier series to 
determine (when possible) the set of coefficients. 


Exercise 9 


Use Steps 1-6 of Procedure 1 to find the general solution of the partial 

differential equation 
Ou Ou 
2 i 
Ox? Ot? 

subject to boundary conditions 


wt) =u, 6)=0,. b> 0, 


2 The diffusion equation 


The diffusion equation takes the form 

Oc _ Oc 

Ot Ox?’ 
where D is a positive constant called the diffusion coefficient, and 
c = c(a,t) is a function of x and t. In solving this equation, the aim is to 
find a function c(x,t) that satisfies the equation, subject to given 
boundary and initial conditions. The diffusion equation is one of the most 
widely studied partial differential equations, and it arises in many different 
contexts. 


(36) 


2 The diffusion equation 


This equation is known as the 


two-dimensional Laplace 
equation. 
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Figure 11 A carbon dioxide 
molecule (coloured) moves 
erratically as it collides with 
other molecules in air 
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The section begins by discussing the physical concepts that lie behind the 
diffusion equation before going on to derive it. This material will not be 
assessed or examined. Nevertheless, the process of deriving a partial 
differential equation from physical assumptions is a vital skill for scientists 
and applied mathematicians, and you should study Subsections 2.1—2.4 to 
see an example of this process in action. 


Subsection 2.5 uses the method of separation of variables to solve the 
diffusion equation for a particular example; this skill is assessable. 


2.1 Diffusion 


On a microscopic scale, matter consists of molecules, with each chemical 
substance having its own type of molecule. Very often, samples of matter 
are mixtures of different types of molecule. For example, air contains a 
mixture of nitrogen and oxygen molecules, with small quantities of many 
other molecules. 


The molecules are always in motion, and in gases or liquids these motions 
are random and unpredictable. The molecules are very small, typically 
about 10~° m across, and at room temperature they move very quickly (at 
speeds of about 300ms~'). They travel only very short distances in 
between collisions: in a gas they move about 107’ m before colliding and 
changing direction. Figure 11 is a schematic illustration of the motion of a 
carbon dioxide molecule in air. 


This random motion of molecules gives rise to an important mechanism for 
mixing substances: it results in substances spreading out in space, as 
illustrated in Figure 12. This process, called diffusion, mixes substances 
by means of the microscopic random motion of molecules, without the 
need for any macroscopic motion (such as the stirring motion that helps to 
dissolve sugar in coffee). 


e 
5 A a a e A A , e e 
‘ e ® e ‘ : e e = 
be e e e c e e 
e . - . e , 
e *< e C e e “ e 
is e , . e 
e e e e e e e C e 
e 
t=0 t > 0 


Figure 12 The random motion of molecules leads to mixing of substances 


The process of diffusion is vitally important for biological processes. For 
example, your body creates carbon dioxide as a waste product, and this 
must be removed from your tissues very efficiently. Your blood vessels and 
lungs play an important role in carrying carbon dioxide out of your body, 
but it is diffusion that enables carbon dioxide molecules to move out of 
your cells and into the blood vessels. 


2.2 Concentration and flux density 


In principle, diffusion can be described by tracking the motion of a vast 
number of molecules, but this is obviously impractical. For most purposes, 
we do not care about the motion of individual molecules, but we want to 
know how the molecules as a whole reposition themselves. In this 
subsection, we introduce two quantities — concentration and flux density — 
that help us to model the process of diffusion. 


Diffusion generally refers to molecules of a definite type or species, mixed 
in with other molecules that are not of interest. 


Molecular concentration 


The concentration of molecules of a given type at position r is the 
number of those molecules per unit volume, found in a small region 
centred on r. 


If the region has volume AV and contains AN molecules of the given 
type at time t, then the concentration is 


(37) 


Figure 13. The distribution of molecules of a particular type in two 
dimensions (other molecules are not shown). The circles define imaginary 
regions centred on r; and rg. Counting molecules of the given type in 
these regions shows that their concentration is higher at r; than at ro. 


To give a detailed description of the distribution of molecules, the volume 
AV should be small on an everyday scale. But it must not be too small, or 
it is unlikely to contain any molecules of the given type! In practice, a 
suitable compromise can generally be reached, giving a function c(r,t) that 
varies smoothly with r and t. 


We also need to describe the motion of molecules. In the case of diffusion, 
the molecules are moving around at random, but we can talk about the net 
motion in a given direction. 


2 The diffusion equation 
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Suppose that we wish to describe the net flow of molecules of the given 
type in the x-direction at a particular position r. Then we imagine a small 
imaginary planar surface element that is centred on position r. The 
surface element has area AA, and it is oriented so that it is perpendicular 
to the x-direction, with its unit normal vector pointing in the x-direction 
(see Figure 14). 


In the small time interval between t and t + dt, we count the number of 
molecules of the given type that pass through this surface element in the 
sense of increasing x (i.e. from the back to the front of the surface in 
Figure 14). Let this number be 6n*. We also count the corresponding 
number of molecules passing through the surface in the opposite sense. Let 
this number be én~. We care only about the net migration across the 
surface in the x-direction, which is defined by 


én = dnt —6n-. 


We expect dn to be proportional to the time interval dt, and to the 
area AA. We therefore write 


in = J, AA6t, (38) 


where J, is a quantity called the flux density in the x-direction. Making J, 
the subject of this equation leads to the following definition. 


Molecular flux density 


For a given type of molecule, the flux density in the x-direction at 
position r and time t¢ is defined as 

— 1 én 

~ AA 6t’ 

where AA is the area of a surface element, centred on r and 
perpendicular to the z-axis, and 6n/ot is the rate of net migration 
across this surface in the direction of increasing x at time ft. 


eo) (39) 


The same sort of caveats surround this definition as for concentration: the 
area AA and the time interval d¢ should be taken to be small, but not too 
small! Again, this is no cause for concern, and the flux density defined by 
equation (39) can be assumed to vary smoothly in space and time. 


A comment on notation 


Note that 6n in the above equations is the number of molecules 
migrating across a surface in time dt. It should not be confused with 
AN in equation (37), which is the number of molecules in a small 
volume. 


In this section, we use A to indicate small quantities associated with 
a small volume or a small area, and 6 to indicate small quantities 
associated with a small time interval. 


2.3 The equation of continuity and Fick’s law 


Our aim is to derive the diffusion equation (36), which is a partial 
differential equation for the concentration c of molecules of a particular 
type. To achieve this, we use two different relationships between the 
concentration c and the flux density J,. Then, by eliminating the flux 
density from these equations, we obtain the diffusion equation. 


This subsection develops the two required relationships, beginning with the 
equation of continuity for diffusing molecules, which is very similar to the 
equation of continuity for a fluid discussed in Unit 10. Because 

equation (36) contains only one spatial variable, 7, we consider a 
one-dimensional situation. 


The equation of continuity 


Consider the diffusion of molecules in a narrow glass tube containing a gas. 
To take a concrete example, suppose that the tube contains air with a 
small amount of carbon dioxide gas. The tube is aligned with the x-axis, 
and we focus on the small element of it that lies between x and x + Az, 
where Az is small. Taking the internal cross-sectional area of the tube to 
be AA, the volume of gas contained in the volume element is 

AV = AAAz. If at time ¢ the concentration of carbon dioxide molecules 
is c(z,t), then the number of carbon dioxide molecules in the element is 


AN jee dt) AV =c@,t) AA Ag. (40) 


We now make the key assumption that carbon dioxide molecules are 
neither created nor destroyed in the tube. This implies that no chemical 
reactions take place in the tube that create carbon dioxide molecules from 
other substances or that split carbon dioxide molecules apart. Assuming 
that the walls of the glass tube are impermeable to gases, it follows that 
any change in AN must be caused by molecules that flow into or out of 
the element by crossing one of the two plane surfaces of area AA at its 
ends. We consider the flows of carbon dioxide molecules through these 
surfaces in the time interval between ¢ and t + ot (see Figure 15). 


Jala) OF Jx(x + Az, t) dt 


particles enter ——> ——-» particles leave 


x x+Az 


AN =c(az,t) AAAz 
particles in interval 
of length Ax 


Figure 15 The equation of continuity is derived by considering the 
change in concentration that results from flow into and out of a volume 
element 
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From equation (38), the net number of carbon dioxide molecules that enter 
the volume element by passing through the left-hand surface at x is 


one) = Jet) AAO. 
Similarly, the net number of carbon dioxide molecules that leave the 
volume element by passing through the right-hand surface at « + Az is 
én(a + Ax) = J, (x + Az, t) AA ot 


Ode 
~ | Jz(a,t) + Aa 


(a, t) Ax| AA dt, 
where we have used the first-order Taylor polynomial approximation for 
J,(xz + Az,t) in the last step. 


Taking the difference between 6n(x) and 6n(x + Az) gives the net change 
in the number of carbon dioxide molecule in the volume element: 


(AN) = én(x) — dn(x + Az) = a (a, t) Ag AA ot. 


From equation (40), this can also be expressed in terms of a change in 
concentration in the volume element: 

(AN) = dc(z,t) AA Az. 
Comparing these last two equations, we see that 


Oils 


dale) = . (36) ot. 


Finally, we divide by dot and take the limit as dt > 0 at constant x, so that 
dc/dt becomes the partial derivative 0c/Ot. We obtain the following result. 


The equation of continuity for diffusion 


Ge Os; a (41) 


oe 


This is the first of the equations that links concentration to flux density. 


Fick’s law 


The second equation linking concentration to flux density is called Fick’s 
law. We know from observing the process of diffusion that molecules of a 
given type tend to move from regions of high concentration to regions of 
low concentration (see, for example, Figure 12). This suggests that the flux 
density of diffusing particles might be related to the gradient of their 
concentration. In one dimension, a plausible relation between the flux 
density J, and the concentration c is as follows. 


Fick’s law of diffusion 


Fick’s law of diffusion states that 


oe DS (42) 


where D is a positive constant called the diffusion coefficient. The 
minus sign indicates that the net flow is from regions of high 
concentration to regions of low concentration. 


When Fick’s law was first proposed in 1855 it was an inspired piece of 
guesswork. While Fick’s law can now be derived from a microscopic theory 
of diffusion, the methods are far beyond the scope of this module. 
Together with the equation of continuity, Fick’s law leads directly to the 
diffusion equation, as you will see in the next subsection. 


2.4 The diffusion equation 


Equations (41) and (42) are two partial differential equations that relate 
the concentration c to the flux density J,. If we substitute (42) into (41), 
we obtain an equation that contains c alone: 


Qc OJ, =( D5) 


ot =6 0x ~—é< CC 
so 

Oc _ 0c 

Ot Ox?’ 


which is the diffusion equation in one dimension, x. This is the form of the 
diffusion equation that is used in this unit. However, for interest only, the 
following box indicates how a diffusion equation arises in three dimensions. 
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Combining equations (43) and (44), and using the methods of 
Unit 10, it can be shown that 
Oe. Oc i Oc ff 0c 
Ot Ox? = Oy? Oz? |’ 
and this is the three-dimensional diffusion equation. It is often 
expressed in terms of the more compact notation 


Oc 
= = pw 
on WG 
where 
v2 a 0? On 


ie ae ae 


is called the Laplacian operator. 


An interesting facet of the diffusion equation (whether in one dimension or 
more) is that it is a deterministic equation that contains no random 
numbers, but which nevertheless describes the random motion of many 
molecules. Of course, an important element of diffusion is that the 
molecules in a gas or liquid make many small unpredictable steps. Many 
other situations involve a large number of random changes, and the 
diffusion equation has been adapted to describe a vast range of 
phenomena. One important application relates to finance. 


The Black-Scholes equation 


The price of a traded commodity or share rises and falls in an 
unpredictable manner, similar to a coordinate of a molecule in a gas. 
Thus a diffusion equation might be used to predict how the future 
value of a portfolio of shares is expected to vary. A particular form of 
diffusion equation, known as the Black-Scholes equation, is widely 
used by financial institutions to determine the value of contracts that 
involve commitments to buy or sell on a date in the future. 


Trading ‘options’ represents a vast amount of economic activity, and 
the value of the diffusion-based model for valuing these contracts was 
recognised by the award of a Nobel prize in economics in 1997. 


2.5 Solving the diffusion equation 


This subsection returns to the major theme of this unit — the solution of 
partial differential equations by the method of separation of variables. It 
presents a problem involving the diffusion equation, broken down into a 
number of steps. Study it carefully because it differs in several details from 
the guitar string problem discussed in Section 1. 


Example 2 


In this question, you are asked to use the method of separation of variables 
to solve the diffusion equation in the form 


ac 1 Oc 

aS 1,t>0 

Ox? —s- <Ts Ot es tee 
for the function c(z,t), where D > 0 is a constant. The equation is subject 
to the boundary conditions 

Oc Oc 

“(0,t) = (Lt) =0 (t>0 

720.) =s-(L.t)=0 (&>0) 


and the initial condition 
CeO =f) Waa = o). 
The solution can be found by completing the following steps. 
(a) Use the method of separation of variables, with c(x,t) = X(x) T(t), 
and show that the function X(x) satisfies the differential equation 
X" —pX =0 (45) 
for some constant 4. What boundary conditions must X also satisfy? 
(b) Show that if 4 > 0, then there are no non-trivial solutions of 
equation (45). 


(c) Show that if 4 = 0, then there is a non-trivial solution of 
equation (45). Determine a form of this solution that satisfies the 
boundary conditions. 


(d) Find the non-trivial solutions of equation (45) satisfying the boundary 
conditions when p < 0, stating clearly what values p is allowed to take. 
(e) Find and solve the differential equation that T must satisfy. 


(f) Use your answers to write down a family of product solutions 
c(az,t) = X(x) T(t) that satisfy the boundary conditions. You may 
assume that the general solution of the partial differential equation 
may be expressed as an arbitrary linear combination of members of 
this family. Write down an expression for the general solution. 


(g) Briefly describe how you would use the initial condition c(x,0) = f(z) 
to determine the particular solution of the partial differential equation. 


Solution 
(a) Writing c(xz,t) = X(x) T(t) and substituting into the diffusion 
equation gives 


X"(0) T(t) = = X(2) T'), 


and dividing through by X (a) T(t) gives 
Aa) LO) 


X(x)  D T(t)’ 


2 The diffusion equation 


Only one initial condition is 
needed because the diffusion 
equation is first-order in time. 
By contrast, the wave equation 
is second-order in time and 
needs two initial conditions. 


For brevity, we use primes to 
denote derivatives: X’ = dX/dx 
and T’ = dT/dt, and so on. 
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Throughout this solution, we 
reuse the letters A and B for 
different arbitrary constants. 
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Because the left-hand side is a function only of x, and the right-hand 
side is a function only of t, both sides must be equal to the same 
separation constant ju, so 


X" (x) Lor" eo) 
X(«) © DT(t) 
Thus we obtain two ordinary differential equations: 
XS FF SDE, 
Noting that 0c/Ox = X'(x) T(t), the boundary conditions imply that 
X'(0) = X’(L) = 0. 


If 4» = k? > 0, where k is a positive constant, then the differential 
equation for X(x) has the auxiliary equation \? = k?, so \ = +k and 
the solutions are of the form 


X (x) = Aexp(kx) + Bexp(—kz), 


where A and B are arbitrary constants. 
Differentiating X (x) gives 
X'(x) = kAexp(kzx) — kBexp(—kz), 
so the boundary conditions X'(0) = 0 and X'(L) = 0 become, 
respectively, 
kA-—kB=0 and kAexp(kL) —kBexp(—kL) =0. 


The first condition implies that A = B. Substituting this into the 
second condition, and remembering that k 4 0, we get either A = 0 or 
exp(kL) = exp(—kL). The first possibility is not considered further, 
because it leads to the trivial solution c(x,t) = 0. The second 
possibility gives 

exp(2kL) = 1, 


which cannot be satisfied for k > 0 and L > 0. We conclude that there 
is no non-trivial solution for p> 0. 
If «4 = 0, then solutions are of the form 

X(t) = A+ Ba, 


where A and B are arbitrary constants. The derivative of this solution 
is X'(2) = B. This time, both the boundary conditions imply that 
B=0, but they do not constrain A. Therefore if ~ = 0, there is a 
non-trivial solution of the partial differential equation, say X(x) = Ao, 
where Apo is an arbitrary constant. 


If « = —k?, where k is a positive constant, then the general solution of 
the equation for X(x) is of the form 


X (x) = Acos(kx) + Bsin(ka), 


where A and B are arbitrary constants. The derivative of this solution 
is 


X'(x) = —Aksin(kx) + Bkcos(kz). 


— 


The boundary condition X’(0) = 0 gives Bk = 0, so we must have 
B=0, allowing us to write 


X'(x) = —Aksin(kz). 


The boundary condition X’(L) = 0 then gives either Ak = 0 or 
sin(kL) = 0. Because k # 0, the first possibility gives A = 0. This 
leads to the trivial solution c(x,t) = 0, and is neglected. The 
remaining possibility gives k = nz/L, where n is any integer. The 


allowed values of js = —k? are therefore 
en 


The value n = 0 can be excluded because it gives = 0, and we are 
currently assuming ps < 0. The corresponding solutions for X (a) are 
X (x) = A, cos (=) 


In both this equation and the equation for yw, the values for n can be 
restricted to the positive integers n = 1,2,3,..., because —n gives 
exactly the same solutions and values as +n. 


Since pp = —n?71?/L?, the differential equation satisfied by T(t) is 


n?n?D 
T(t) = a T(t), 
with n = 1,2,3,.... The general solution is of the form 
22 
n*n* Dt 
Tn(t) = Oy exp (-) (i 12 Boiss) 


where a, is an arbitrary constant. 


Assimilating the two arbitrary constants into one (i.e. replacing A,a, 
with C,,), the family of product solutions is 


32 
Dt 
Cyl: t) = C), cos (=) exp (-* - ) (n= 1,2,3,...), 
supplemented by the constant solution 


co(x, t) = Co. 


The general solution is therefore of the form 


O° a) 
Dt 
c(x,t) =Cot+ ) Cp, cos (=) exp (-* = ) 
n=1 


Setting t = 0 in the general solution, the initial condition 
c(xz,0) = f(x) gives 


c(z,0) = Co+ > Cp, cos (=) = f(z). 
n=1 


The coefficients Co and C;, can therefore be recognised as the 
coefficients that appear in the cosine Fourier series for f(x) over the 
interval 0 < a < LD. We can therefore find these coefficients by using 
the even periodic extension of f(x). 


2 The diffusion equation 


Note carefully why the even 
periodic extension of f(a) is 
needed here. 
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Some authors use a different 
symbol, such as a, for the 
thermal diffusivity. 
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Assuming that this has fundamental period 2Z, and using 
equations (39) and (40) from Unit 11, we get 


Co = of 1) at, Cyp= A [1 cos (=) ax: 


3 Modelling heat flow 


3.1 The heat equation 


It turns out that the diffusion equation (36) also describes the conduction 
of heat. In a one-dimensional situation, if 6(a,t) is the temperature at 
position x and time t, then it is often valid to assume that 


00 00 

— = D—,. 

ot Ox? 
This is identical to the diffusion equation but, in this context, the equation 
is called the heat equation, and the constant D is called the thermal 


diffusivity. We do not derive the heat equation here, but the link with 
diffusion is intriguing, so we make a few remarks about it. 


(46) 


If you apply heat to a metal object, such as a saucepan, by holding it over 
a flame, then its temperature increases at the point where the heat is 
supplied. If you remove the pan from the flame, then the heat spreads out 
so that hot parts become cooler but other parts of the pan become warmer. 
Although heat is not a substance (it is a form of energy), it does behave in 
many respects like a fluid, diffusing from hot regions to cooler ones. 


The quantities of concentration and flux density, which you met in the 
context of molecular diffusion, have analogues in the context of heat flow. 
Temperature can be modelled as being proportional to the heat energy 
density, which is analogous to concentration, and there is a heat flux 
density that is analogous to the flux density for molecules. Moreover, it is 
reasonable to assume that the heat energy density obeys an equation of 
continuity, and by analogy with Fick’s law of diffusion, the heat flux 
density obeys the equation 


heat flux density o —temperature gradient, (47) 


which is called Fourier’s law. When all these things are put together, it 
is possible to justify equation (46), following much the same route as used 
for the diffusion equation in Section 2. 


At a broader level, the analogy is that the conduction of heat occurs via 
many random steps that involve the transport of heat energy, while 
molecular diffusion occurs via many random steps that involve the 
transport of matter. 


3.2 Heat flow in rods 


We consider a straight thin metal rod of length Z with a uniform 
cross-section. The position of a point on the rod is measured by the 
distance x from one end. The temperature at this point is 0, which is a 
function of position x and time t. Two different problems are introduced in 
this subsection, and then solved in the subsections that follow. 


A thermally insulated rod 


The simplest case occurs when the only direction of heat flow is along the 
rod. In this case the temperature satisfies the one-dimensional heat 
equation 
2 

a0 _ oe 

Ot Oz? 
Usually, a heated metal rod loses heat to its surroundings, so that heat 
flows out of its sides as well as along its length. This flow of heat to the 
surroundings can be stopped (or at least greatly reduced) by covering the 
rod with a thermal insulating layer (an example is the layer of foam plastic 
that is used to cover water pipes in houses). For this reason we will refer 
to the case where the temperature satisfies equation (46) as the insulated 
rod. 


(Eq. 46) 


The boundary conditions depend on what happens at the ends of the rod. 
There are two important cases. 


e If the ends of the rod are insulated, then no heat can enter or leave 
them. Fourier’s law (47) then implies that the temperature gradient 
06/0x is equal to zero at both ends of the rod. This applies at all times 
of interest, so in mathematical notation, the boundary conditions are 


a0 a0 
Ope = 4 
at =0, s(Lt)=0, +>0 (48) 


e = If the ends of the rod are in contact with a body that is at a fixed 
temperature 69, then the boundary conditions are 


6(0,t) = 60, O(L,t)=60, t>0. (49) 


In this case, heat may flow from the centre of the rod and out through 
its ends, even though these are maintained at a fixed temperature. 
Hence, by Fourier’s law, the temperature gradient 00/0x need not be 
equal to zero at the ends of the rod. 


In addition to the boundary conditions, we need an initial condition. 
Typically, this is given by a function f(x) that describes the initial 
distribution of temperature along the rod at time t = 0. This initial 
condition is written as 


(20) —f(x), Var < tL. (50) 
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This relationship was introduced 
by Newton and is sometimes 
called Newton’s law of 
cooling. 
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Exercise 10 
Show that the function 


satisfies the heat equation (46) and boundary conditions (49) if 69 = 0. 


A convecting rod 


The second case that we will discuss is that of a rod that is not thermally 
insulated, but is surrounded by air. In this case, heat is not only 
conducted along the rod, but also lost from its sides. Loss of heat from the 
sides of the rod occurs through a process called convection. In this 
process, as the air around the rod is heated, it expands and rises, so air 
currents are set up. The process of convection differs from the process of 
conduction that leads to the heat equation (just as the process of stirring a 
liquid differs from diffusion). It is therefore not surprising that heat loss 
due to convection is not described by the heat equation. 


Convection is a complex process, but if a hot body at a uniform 
temperature @ is surrounded by cooler air at temperature 0,;,, the rate of 
drop of temperature of the body can be modelled as being proportional to 
the temperature difference 0 — 0,;-. We therefore write 

dé 

dt 
where ¥ is a positive constant that depends on the body’s size, shape and 
composition. The initial minus sign on the right-hand side shows that the 
temperature of the body is decreasing. 


= —7(0 — air), (51) 


| convection 


In equation (51), the body is assumed to have a single temperature at each 
moment in time. In general, the temperature of a convecting rod depends 
on both position « and time t. We can take account of both conduction 
along the rod and convection away from the sides of the rod by adding a 
term — (0 — air) to the right-hand side of the diffusion equation (46), 
where 6 = @(x,t) is now a function of position as well as time, and 6,ir is a 
constant. We therefore take the partial differential equation for a 
convecting rod to be 


00 00 
OE =D ae — (0 _ Vaz). (52) 


The boundary and initial conditions are as for an insulated rod. 


Exercise 11 


Write down the initial condition describing the temperature distribution if 
the central third of a rod with ends at x = 0 and x = L is initially heated 
to a temperature 6, while the remainder of the rod is at the 

temperature 6. 


We now solve the two types of problem in turn: first the insulated rod in 
Subsection 3.3, and then the convecting rod in Subsection 3.4. 


3.3. The insulated rod problem solved 


This subsection uses Procedure 1 (the method of separation of variables) 
to solve the heat equation for the insulated rod problem introduced in 
Subsection 3.2. 


In our model, the temperatures at the ends of the rod are zero 

(0(0,t) = @(L, t) = 0 in appropriate units), and we suppose that the initial 
temperature of the rod at t = 0 is given by a function f(x) that is very 
similar to the initial displacement function for the taut string problem 
considered in Section 1 (equation (31)). This initial temperature 
distribution is sketched in Figure 16. 


In mathematical terms, the model is 


0°01 «08 

Oa? — D Ot’ ) 
subject to boundary conditions 

0.4) =O L7)=0, 20, (54) 


and initial condition 
2 
a for0O<a< 5L, 
A(x, 0) = f(z) = (55) 


20 
F(L-2) for 5L <a <L. 


You will see that the solution of this problem is simplified by having @ = 0 
at the ends of the rod. This might seem strange because there are many 
different temperature scales, and a temperature of zero degrees Fahrenheit, 
for example, has no great physical significance. In fact, the choice of 
boundary conditions in equation (54) is made purely for mathematical 
convenience. You will see later how our solution can be adapted to cover 
any fixed temperatures at the ends of the rod. 


e Step 1 Prepare a product solution 


We prepare to separate the variables by writing 


O(x,t) = X(x) T(t), (56) 
and finding the relevant partial derivatives: 

00 

anaes X"T 

ae (57) 

00 } 

a= XT". (58) 


e Step 2 Separate the variables 


To get separate ordinary differential equations for X(a#) and T(t), we 
substitute the formulas for the partial derivatives into the partial 
differential equation, and rearrange. 


3 Modelling heat flow 


Figure 16 Initial 
temperature distribution for 
the insulated rod problem 
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Substituting equations (57) and (58) into equation (53) gives 


1 
X"T = =XT’. 
D 
Dividing by XT then gives 
xa Tae 
X 7 DT 69) 


The left-hand side is a function of the variable x alone, and the 
right-hand side is a function of the variable t alone, so both are equal 
to the same separation constant 4. Thus the single equation (59) gives 
us the pair of equations 
X" — X =0, (60) 
r= Det =). (61) 


Step 3. Prepare the boundary conditions 


To find the boundary conditions for X (x), we write 
O(z,t) = X(x) T(t), substitute in x = 0 and x = L, and then use the 
given boundary conditions for 0(x,t). This gives 
X (0) T(t) = X(L) T(t) = 0 for t > 0, and hence 

X(O) = XL) = 0. (62) 
Step 4 Find the functions X,,(z) 


The differential equation (60) for X, and its boundary conditions (62), 
are the same as in Subsection 1.2, so we need not repeat the 
arguments. You have seen that a non-trivial solution occurs only if the 
constant sj is negative. Hence, as before, we replace ps by —k?. 


As before, & must take one of the values k,, = na/L, where n is an 
integer. As explained in Section 1, n can be restricted further to the 
positive integers, n = 1,2,3,.... The allowed values of the separation 
constant are p,, = —k? = —n?7?/L?, and each of these values 
corresponds to a solution 


Ant) =, snl ke) =, sii. (=) , n=1,2,3,..., (63) 
where B,, is an arbitrary constant. 


Step 5 Find the functions T,,(z) 


The function T(t) satisfies the differential equation T’ = Du T, where 
pu is restricted to the values pi, = —k2. We therefore need to solve the 
first-order differential equation 


T,, (t) a —Dk-T, 


which has general solution 


nn? Dt 
L? : 


where Q@, is an arbitrary constant and n = 1,2,3,.... 


Tn(t) = On exp(—Dk2t) = an exp (- 


e Step 6 Construct the general solution 


By combining X,,(t) and T,,(t), we obtain a family of product 
solutions X,,(x) T,,(t) that satisfy the heat equation (53) and its 
associated boundary conditions (54). This family is 


. (NTL nn? Dt 
6,(x,t) = Cy sin (=) exp (- = ) , n=1,2,3,..., (65) 


where C,, = By,a, is obtained by combining the arbitrary constants 
B, and a,. The general solution is an infinite linear combination of 
members from this family: 


0° a) 
GE. t) = S> C,, sin (=) exp (-* =) : (66) 
n=1 


e Step 7 Apply the initial condition 


Setting t = 0 in equation (66) gives 


6(x,0) = 3 C,, sin (=) : 
n=1 


The function f(x) used in initial condition (55) is essentially the same 
as that used in Section 1, hence we arrive at the same values for the 
coefficients C,,. The required particular solution is therefore 


_ (TL 1? Dt 
ica (7) a. ae 
1. 37x On? Dt 
= 9 sin ie. exp = i 
1 . (daa 2577 Dt 
+ 358i (77) ow (-2 Be) -- / Ve 


As promised earlier, let us now see how to adjust this solution to cover the 
case where the ends of the rod are maintained at a constant non-zero 
temperature 69 4 0, i.e. where the boundary conditions are 


6(0,t) = O(L,t) = 60, t>0. (68) 


84) 


(2,4) = =) 


The trick is to notice that the constant function 0(x,t) = 00 satisfies the 
heat equation (53). This is because all of its partial derivatives are equal 
to zero, so substituting into the heat equation gives 0 = 0. If we ignore the 
boundary conditions for the moment, then the principle of superposition 
tells us that any linear combination of solutions of the heat equation is also 
a solution. So we can add the constant solution 69 to the solution obtained 
in equation (66) to get another solution of the heat equation: 


ae . (nTre nn? Dt 
6(x,t) =O00+ ) Cr, sin (=) exp (- RP ) : (69) 
n=1 


If we substitute « = 0 or x = LD into this expression, we already know that 
all the terms in the summation will give zero (because they satisfy the 
boundary conditions 6(0,t) = 0(L,t) = 0). 
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It follows that 0(x,t) in equation (69) satisfies the new boundary 
conditions in equation (68). In fact, it is the general solution of the heat 
equation subject to these boundary conditions. 


Exercise 12 
Consider the heat equation 


0°70 ~— 1 «<6 


dx2 D Ot’ 
subject to the boundary conditions 
(0,2) =O b,1) = 0p. to 0, 


where 09 4 0. Explain how you would obtain the particular solution that 
satisfies the initial condition 


(2,0) = fle), Vser< ZL, 


where f(z) is a given function that is equal to 6) at x =O and x= L. 


Exercise 13 


Consider the heat equation 


0°01 «00 
dx2 <TD Ot’ 
These boundary conditions subject to boundary conditions 
model the situation where the 
ends of the rod are kept at two A(0,t) =, O(L,t)=O1, t>0, 


Henin Ae raperanures where 99 and 9; are non-zero constants, and initial condition 


(20) =fe), Oe < 2, 
for some function f(z). 

(a) Show that the function 
L-¢£ 
L 
satisfies the differential equation and the boundary conditions. 


jee Oy + = 61 


(b) Write down the general solution of the partial differential equation 
subject to the boundary conditions. 


(c) Explain how you would go on to obtain a solution that also satisfies 
the initial condition. 


3.4 The convecting rod problem solved 


In this subsection, we again use Procedure 1 (the method of separation of 
variables). This time, we solve the heat equation for the convecting rod 
problem, sharing the solution between text and exercises. 


We suppose that the ambient temperature of the air, and the temperature 
at the ends of the rod, are equal to zero (in appropriate units). The initial 


122 


condition is the same as for the insulated rod. In mathematical terms, the 
problem is 


00 00 
— = D—-°%0 70 
ot Ome (70) 
where D > 0, subject to the boundary conditions 
CO.2=0 11) =0, £20, (71) 
and the initial condition 
20 
Se forO<a< sL, 
O(z,0) = 46 (72) 
= (L- 2) for 5L <<a < L. 
Exercise 14 


Carry out Steps 1 and 2 of Procedure 1 for the convecting rod problem, as 
follows. 


(a) Prepare a product solution for substitution into equation (70). 


(b) Separate the variables. 


The ordinary differential equations derived in Exercise 14 are 
X" — pX =0, 
T’ = (Du —)T. 


Steps 3 and 4 in Procedure 1 tell us to prepare the boundary conditions for 
X(zx) and to solve the differential equation for X(x) subject to them. 
Applying the given boundary conditions to the product function 

O(a, t) = X(x) T(t) gives X(0) T(t) = X(L) T(t) = 0, so the boundary 
conditions for X(x) are 


X(0)}=0 ond X(L) =0. 


These are the same boundary conditions as those used for an insulated rod 
(in Subsection 3.2) and for a string (in Section 1). The same arguments 
apply, so we do not repeat them here — although you would need to when 
answering an assignment question! 


In brief, the conclusions are as follows. In order to get non-trivial solutions 
that satisfy the boundary conditions, 4 must be negative. Writing 

pu = —k?, the boundary conditions require that k takes one of the values 
kn = nt/L, where n is an integer. The corresponding solutions for X (x) 
are 


X,(e) = Basu (=) » WH 1B Bics es 
where B,, is an arbitrary constant. The values of n have been restricted to 


the positive integers because n = 0 gives the trivial solution and —n gives 
the same solution as +n. 
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Exercise 15 


Step 5 in Procedure 1 asks us to solve the differential equation for T(t), to 
find the functions T,,(t) that accompany X,,() in the product solutions. 
Carry out this step using the differential equation for T’ obtained above. 


In Step 6 of Procedure 1 we combine the solutions for X,,(x) and T,,(t), to 
obtain a family of product solutions of equation (70) subject to boundary 
conditions (71): 


2,2 

(Nx nen 
O,\f.1)=]C, 6m (=) exp - (p RE + ”) J 
nat 

T2 

where we have combined the arbitrary constants B, and a, to give 
Cn = Bnan. The general solution of the partial differential equation, 
satisfying the associated boundary conditions, is then given by the infinite 
sum 


= Cn sin (“*) exp |-p ie = 1.2, Sis 


oo Din Dy 
O(a, t) = eu NC, sin (=) exp p= | : 
n=1 


The factor e~% has been brought outside the summation because it is 
independent of n. 


Finally, Step 7 of Procedure 1 asks us to apply the given initial condition. 
Setting t = 0 in the expression for the general solution gives 


2:0) = e C;, sin (=) : 
n=1 


and we can equate this to the given initial temperature distribution f(z), 
given in equation (72). The computation of the Fourier coefficients is 
exactly the same as in the previous cases (see, for example, 

equation (67)).We conclude that the required particular solution is 


80 "Dt 
O(x,t) = a et ss (=) exp (5 ) 
1. (37% On? Dt 
5 sin | = } exp Rp 
1, (dxx 25n Dt 
+ spsin (7) exp (- B )--} (73) 


This is the same as the solution for the insulated rod except for the e~” 
factor, which ensures that the convecting rod cools more quickly towards 
the ambient zero temperature than the insulated rod. 
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4 Taking a broader view 


This final section will not be assessed in continuous assessment or in 


the exam, but you should read it, especially if you plan to study 
further modules in the physical sciences or applied mathematics. 


This section differs in style from the rest of the unit because it takes a 
light-touch approach, emphasising concepts rather than problem solving. 
After a brief review of some areas of science that use partial differential 
equations, we consider solutions of the wave equation and the diffusion 
equation that apply when the region of interest has no boundaries, or has 
boundaries that are so far away that they do not influence the solutions. 
Under these circumstances, there are alternative methods of solution, not 
based on the method of separation of variables. 


4.1 The importance of partial differential equations 


Partial differential equations have a vast range of applications. This is 
partly because many fundamental laws of physics are expressed directly in 
terms of them. So when physical theories are applied to other subjects, 
such as climate science, astrophysics or physiology, partial differential 
equations are often used. 


Partial differential equations in action 


e The laws of electromagnetism are expressed as a system of 
equations called Mazwell’s equations. These lead to a 
three-dimensional version of the wave equation that describes 
light and similar waves. Electrostatic phenomena are also 
described using a partial differential equation called Poisson’s 
equation. 


e Atoms and molecules are best described using quantum 
mechanics. The description often involves using a partial 
differential equation called the Schrodinger equation that is 
closely related to both the wave equation and the diffusion 
equation. 


e A vast range of phenomena involve the effects of numerous small 
random motions, and are described by variants of the diffusion 
equation, including the Black-Scholes equation for price 
fluctuations. 


e The motion of fluids is described by non-linear partial differential 
equations called the Navier-Stokes equations. These equations 
are used in oceanography and weather science. 
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Figure 18 Wave ripples 
produced by dropping a stone 
into a lake 
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e The most successful theory of gravity, called general relativity, is 
expressed as a system of non-linear partial differential equations. 
These equations are used to model the expansion of the Universe 
and the collapse of black holes. 


A basic classification of partial differential equations distinguishes between 
linear and non-linear equations. The fundamental partial differential 
equations of electromagnetism and quantum mechanics are linear, and so 
is the diffusion equation. But the Navier-Stokes equations of fluid 
mechanics are non-linear, and so are the equations of general relativity. 


This distinction is important because non-linear partial differential 
equations are usually very hard to solve using mathematical analysis alone. 
The solutions may be too complex to allow description by manageable 
mathematical formulas, and investigations using computer programs may 
be the only practical approach. An example is given in Figure 17, which 
shows a solution of the Navier-Stokes equations for the flow of a gas above 
a hot surface. 


Thermal convection, constant viscosity 


0 1000 2000 3000 4000 5000 6000 7000 8000 
x (km) 


Figure 17 A computer-generated colour-coded image of the temperature 
of air above a hot surface, with ‘plumes’ of hot air rising at apparently 
random positions 


4.2 Travelling wave solutions of the wave equation 


When discussing waves on a string earlier, we kept the ends of the string 
clamped. This introduced boundary conditions that restricted the family 
of product solutions obtained by the method of separation of variables. 


However, there are many situations where boundary conditions are 
irrelevant. When a stone is dropped into the middle of a large lake, the 
ripples that spread out do not depend strongly on the details of the lake’s 
shoreline (Figure 18). It therefore makes sense to consider solutions of the 
wave equation that apply in the absence of boundary conditions. In the 
context of a string, we simply ignore the ends of the string and treat it as 
if it were infinitely long. This may seem rather artificial for a string, but it 
is often a good way of thinking about the propagation of light, sound and 
many other types of wave. 


4 Taking a broader view 


In the absence of boundary conditions, a proposed solution need only 
satisfy the wave equation. One function that does so is 


u(x,t) = Asin[k(a — ct)], (74) 


where A and k are constants, and c is the wave speed that appears in the 
wave equation. You can check this by calculating the relevant partial 
derivatives and substituting into the wave equation. 


Exercise 16 
Check that the function in equation (74) satisfies the wave equation 
Ou 1 Ou 


ee Sih 
Ox? —s c-_—: O?. 


Exercise 16 showed that the function A sin[k( — ct)] is a solution of the 
wave equation for any values of & and A. This function varies sinusoidally, 
and gives a train of wave crests and troughs that move through space as 
time progresses (Figure 19). The distance between two successive wave 
crests is the wavelength of this sinusoidal wave. The wavelength . is 
related to the constant k in equation (74) by kA = 27, so \ = 27/k. 


SY 


Suppose that at time ¢, a particular crest is at position x. At a slightly 
later time t + At, the same crest has moved to position r+ Az. The 
function A sin[k(x — ct)] must take the same value at both these instants, 
So 


= - 


Figure 19 A sinusoidal wave 
solution travelling in the 


Asin[k(a + Ax — c(t + At))] = Asin[k(ax — ct)). positive «x-direction 


We need to satisfy this equation in a way that ensures that Ax — 0 as 
At — 0. This is achieved by taking 


Ax =cAt. 


The constant c is positive, so Ax > 0 when At > 0, and we see that the 
wave crest (and every other part of the wave) moves in the positive 
x-direction at the constant speed Ax/At = c. This is why the constant c 
in the wave equation is called the wave speed. A disturbance that travels in 
this way is called a travelling wave solution of the wave equation. 


Instead of u(x,t) = Asin[k(x — ct)], we could consider 

u(x,t) = Asin|[k(x + ct)|: the same steps show that this is another 
travelling wave solution of the wave equation. In this case, the wave moves 
in the negative x-direction with speed c. We could also replace 

Asin|k(a — ct)] by Acos|[k(x + ct)| and find that these too are solutions. 


In fact, the crucial feature for a travelling wave solution of the wave 
equation is that x and t should appear in one of the combinations x — ct or 
x+ct. If we take any reasonable function, and work out the partial 
derivatives, we find that f(a — ct) and f(x + ct) are solutions of the wave 
equation, provided that the function f can be differentiated twice. 
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To check that this is true, note that if u(x,t) = f(a — ct), then 


Ou _ ! Ou / 
Ag de t), p= Tf (e- ), 
O7u Wt Ou 2 pi 
gee es oe 
Hence 
Pu 1 Au 1 
Ft ge MGA) Bese et) =0, 


showing that f(a — ct) satisfies the wave equation. A similar argument 
applies to f(a + ct). 


In general, if f and g are two functions that can be differentiated twice, 
then the following function is a solution of the wave equation: 


u(x,t) = f(a —ct) + g(a + ct). (75) 


This is known as d’Alembert’s solution of the wave equation. It is the 
general solution of the wave equation without boundary conditions. It 
consists of two travelling waves, moving in opposite directions, but one or 
other of these waves may be missing in particular cases. There is an 
immense amount of freedom built into this general solution, which can be 
restricted by considering particular initial conditions. 


A solution like f(x — ct) describes a pulse of disturbance that travels at 
constant speed, unchanged in shape, as in Figure 20. The fact that the 
pulse travels unchanged in shape is a consequence of our assumption that 
the wave speed c is a constant. There are other types of wave for which 
this is not true, and whose pulses broaden out as they travel. These are 
described by partial differential equations that are more complicated than 
the wave equation of this unit. Some examples are given in the box below. 


u(a, 0) * 


&v 


Sv 


ct 


Figure 20 A pulse travels at constant speed, unchanged in shape 


Waves are everywhere 


A wave is a disturbance of some kind that either forms standing 
waves or propagates through space as time progresses. The partial 
differential equations satisfied by waves are called wave equations, 
although they may differ from equation (3). 


e Electromagnetic waves are disturbances of electric and 
magnetic fields. In empty space, they satisfy a three-dimensional 
version of equation (3). This equation has sinusoidal solutions 
with definite wavelengths, and the wavelength determines the 
name given to the wave. Radio waves have very long wavelengths; 
as the wavelength decreases, we progress through infrared 
radiation, microwaves, visible light, ultraviolet radiation, X-rays 
and gamma rays. In a vacuum, all these waves have the same 
wave speed, c = 3.0 x 10° ms~!, which is called the speed of light. 


e Sound waves are disturbances of the pressure in a gas or liquid. 
They also obey a three-dimensional version of equation (3). In 


air, sound waves have a speed that is roughly 330ms7!. 


e Water waves on the surface of the sea are very familiar. Their 
wave speed is not a constant, but depends on the wavelength. 


e Quantum-mechanical waves arise in the most fundamental 
theory of nature, quantum mechanics. The relevant wave 
equation is called the Schrodinger equation, which differs from 
equation (3) because it involves complex numbers and only the 
first-order partial derivative with respect to time. 


4.3 Point-source solutions of the diffusion equation 


Finally, let us briefly consider the phenomenon of diffusion in a region that 
is large enough for its boundaries to be irrelevant. If you inject a drop of 
dye into the centre of a large tank of still water, the dye molecules 
gradually spread out from their starting point: this is the essence of the 
phenomenon of diffusion. 


We can imagine an idealised one-dimensional situation in which all the 
molecules start out at « = 0 at t= 0. Because all the molecules start from 
a single point, this initial condition is referred to as a point source. 
Figure 21 shows the spread of concentrations that arise from this source at 
a series of later times. Of course, the spreading out is accompanied by a 
reduction in concentration at the injection point, x = 0. 


4 Taking a broader view 
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c(x, t)/N * 
1.05 


—15 —10 —5 0 5 10 ia 


Figure 21 The concentration resulting from a point source at x = 0 
injected at time t = 0. (The diffusion coefficient D has been taken as 1.) 


The function that describes this spreading out of concentration turns out 
to be 


N x 
Ci) = JinDi exp (-z) (t > 0), (76) 


where N is a constant. Although there are powerful techniques for deriving 
this function, they are not discussed here. However, you can verify for 
yourself that this function does satisfy the diffusion equation. 


Exercise 17 
Show that the function c(x,t) in equation (76) satisfies 
Oc x Oc od 1 
ma BD” and a (aaa) 
Then carry out a further partial differentiation to show that c(,t) satisfies 
the diffusion equation. 


Because it describes the diffusion of a point source at + = 0, released at 
t = 0, the function in equation (76) is called a point-source solution of 
the diffusion equation. 


If the particles had been released from a different point, say x = s, at 
t = 0, then the corresponding point-source solution would be of the form 


sa —_ ae a . 


where JN is another constant. 


Learning outcomes 


It turns out (although again we do not give the details) that the general 
solution of the diffusion equation without boundaries can be expressed as 


sad\= == [ ” 6 aS daa 


where c(x,t) satisfies the initial condition c(x,0) = co(x). Thinking of this 
integral as a sort of ‘continuous sum’, you can see that it can be 
interpreted as a linear superposition of point-source solutions. This is not 
too surprising, since we know that the diffusion equation is linear and 
satisfies the principle of superposition. 


Learning outcomes 


After studying this unit, you should be able to do the following. 


e Understand how the wave and diffusion/heat partial differential 
equations are used to model certain systems. 


e Use the method of separation of variables to find families of product 
solutions for the wave equation, diffusion equation and similar linear 
homogeneous second-order partial differential equations, subject to 
simple boundary conditions. 


e Construct the general solution of a partial differential equation from a 
family of product solutions. 


e Find the values of the coefficients in the general solution of a partial 
differential equation by using given initial conditions to determine the 
coefficients of a Fourier series. 


131 


Unit 12 Partial differential equations 


132 


Solutions to exercises 


Solution to Exercise 1 


The partial derivatives are 


Ou . Ou : 

a Ak cos(kx) sin(kct), a Akcsin(kx) cos(kct), 

O7u 2; . Ou 5 . 

aa —Ak* sin(kx) sin(kct), 3 = —Ak*c* sin(kz) sin(kct), 
so 

du 1 au 

on Or” 


The function does satisfy the wave equation. 


Solution to Exercise 2 
The displacement at t = 0 is 
u(x,0) = Asin(kx) sin(0) = 0. 


The velocity at position x and time t is 


0 
a = Akcsin(kx) cos(kct), 

so the velocity at position x and time t = 0 is 
Ou 


By (t 0) = Akcsin(ka). 


Solution to Exercise 3 
The initial displacement has two linear sections. 


The left-hand section has slope d/(L/3) = 3d/L and has the value u = 0 
at x = 0. It is described by the function u(x) = (3d/L)z. 


The right-hand section has slope —d/(2L/3) = —3d/2L and has the value 
u=0 at « = L. It is described by a linear function of the form 
3d 

ule) = or? +C, 
where C is a constant. Setting u(L) = 0 gives C' = 3d/2, so the right-hand 
section is described by the function 

3d 33d 3d 

WO= or? = of! 
The initial condition for the shape of the string is therefore 
3d 
zt 
3d 
oF 
You can check that both parts of this expression give u(x,0) = d at 
eS Life: 


— 2). 


for0<a< sL, 
u(¢,.0) = 
(L—a) for3L<a<L. 


The condition for the initial shape of the string is supplemented by the 
condition that a plucked string is released from rest: 


a 
5p (210) = 0, O<2<L. 


Solution to Exercise 4 


The function under consideration is 


u(e,t) = sin (=) cos (=) . 


The boundary conditions are satisfied since 


t 


The initial condition is satisfied since 


Ou mc . (ma, . (7et 
5?) =—7 sin (=) sin (=) : 


so att =0, 
0 
Sp (#0) = = sin (=) sin (0) = 0 


Solution to Exercise 5 


Substituting u(x,t) = X(x) T(t) into the partial differential equation gives 


Dividing by XT and equating both sides to the same separation 
constant lu, we get 


ier. ee 
T de" X de®’ 
and this leads to the ordinary differential equations 
PT ctx | 
a 
Solution to Exercise 6 
Substituting u(x,t) = X(x) T(t) into the partial differential equation gives 
dT d d?X 
CS aT | Gx a 
di [te NF ae | 


Dividing by XT and equating both sides to the same separation 
constant lu, we get 


1 dT 1[d (eX) + d?X 
— —_, <= — — 2 —" 
T dt * X|\de dx? |’ 
and this leads to the ordinary differential equations 
dT d d?X 
gO get ae F 
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Solution to Exercise 7 
When u(z,t) = a1 ui(2,t) + ae ua(z,t), 
Oru Oo? 


One = yz aru + agu2) 


| 
} 
= 


_ 0? 1 Ou 


= Fs Wp (41U1 + G2u2) = = aS 
Cc? apm 1 + agua) c2 Ot?’ 
so the linear combination satisfies the wave equation. 
The given boundary conditions lead to 
u(0,t) = az ui (0, t) + ag u2(0, t) = 0, 
u(D,t) = a; u1(L, t) + ag ua(L, t) = 0, 
Hence the linear combination u = a,u, + agu2 satisfies the wave equation 
and the given boundary conditions. 
Solution to Exercise 8 


From equation (35), the velocity at t = 0 is 


a(e) = oe (0,0) = 3 (=) By Siti (=) cos(0). 


If the Fourier coefficients of u(z) are C,, then 
L 
By = —Cy, = 15.2, 8h 
nc 


Solution to Exercise 9 
Step 1 Setting u(x,t) = X(x) T(t), the required partial derivatives are 
a Oru 


For brevity, primes are used to = 2), eS eT 
tae Ox? Ot? 
denote derivatives. 
Step 2 Substituting into the partial differential equation and dividing by 
XT gives 
xX! i ek 
~_+ _=0, 
xX - T 
from which it follows that 
Nel hua 
x 
Both sides of the equation must be equal to the same constant py, giving 
x! epee 
a d -—=nh, 
| ae woe 


or equivalently, 


X"—pX=0 and TT” +yT=0. 
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Step 3. The boundary conditions become X (0) = X(1) = 0. 


Step 4 Arguing as in Subsection 1.2, only negative jz gives a non-trivial 
solution for X. Hence we can write , = —k?, and the differential equation 
for X becomes 


X" +k?X =0. 
This equation has the general solution 
X (x) = Ccos(kx) + Dsin(kz), 


where C and D are arbitrary constants. In order to satisfy the boundary 
condition at x = 0, we must have C = 0. Then, to satisfy the boundary 
condition at x = 1, we must have k = nz for some integer n. So there is a 
family of solutions 


Ay (2) =D, simlnag), = 1,2, 9.00%; 


where we have dropped the value n = 0 because it gives the trivial 
solution X (a) = 0, and we have dropped negative values of n because —n 
gives the same solution as +n (since D, is an arbitrary constant). 


Step 5 With p = —k?, the differential equation for T’ becomes 
T’ =i? = 0. 
This equation has the general solution 
TU\=Ae" + Be, 
Using the allowed values for k, the allowed solutions are 
Ti) = Aes Be. Bo 
Step 6 Replacing D,A, and D,B, by a, and £,,, respectively, the 
required family of product solutions is 
Un(x,t) = sin(ntx) (ane"™ + B,e°"™), n=1,2,3,..., 
where a,, and §,, are arbitrary constants. The general solution is therefore 


Co 


alrt)= S- sin(nmx) (a,e"™ + B,e "™). 


n=1 
Solution to Exercise 10 
We have 


Ox? L? ae. L? ii 

Also, 
00 tD & a? Dt 7 rD (et) 
a0 ae ee 
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Hence 
1 06 Wr 0°60 
Dae 12) = a 


showing that equation (46) is satisfied. 


At the ends of the rod, 
2 


Dt gi: 
6(0, t) = exp ("3 ) sin0=0, 6(L,t) = exp (- — ) sina = 0, 


so the boundary conditions are satisfied if 09 = 0. 


Solution to Exercise 11 
The initial condition is 
Ao for 0 <a < $L, 
O(x,0)=¢ 6 for sL<a< 2, 


A for 3L<a<L. 


Solution to Exercise 12 


The general solution satisfying the given boundary conditions is 


ices 2 2Dt 
O(a, t) = Oo + 2d C,, sin (=) exp (-) ; 
Setting t = 0, we obtain 
nr 


O(x,0) = A + 3 C,, sin (= 
n=1 


So to satisfy the initial condition 0(2,0) = f(x), we need to obtain the C,, 
from the Fourier sine series coefficients of the function f(x) — 60. 
Substituting these coefficients into equation (69) then gives the required 
solution. 


Solution to Exercise 13 


(a) For 
L-« x 
eth =— L Oo + 5 OL, 
we have 
070 00 
dae =0 and OL = 0, 


so the heat equation reduces to 0 = 0 and is satisfied. 
At x = 0, we have 


0(0,t) = —— 


09 +0 = 4, 
and at x = L, we have 
L-L L 
L,t) = —— —6,= 
O(L, t) TL 9 + + OL OL, 


so the boundary conditions are satisfied. 


(b) The general solution takes the form 


L-«2 


L 
NTXL n? 7? Dt 
Cy, si (=) —_—_.—— ], 
+2 sin | exp ( RE ) (*) 


where the C,, are arbitrary constants, and the sum on the right 
satisfies the same differential equation, but with boundary conditions 
corresponding to zero temperature at both ends of the rod. By the 
principle of superposition, the general solution (*) satisfies the partial 
differential equation. It also satisfies the given boundary conditions. 
This is because substituting in x = 0 gives 09 from the terms outside 
the sum and zero from the sum. Similarly, substituting in « = L gives 
9, from the terms outside the sum and zero from the sum. 


62,2) = 89 + = 81 


(c) To find a solution that satisfies the initial condition, we set t = 0 in 
equation (*). This gives 


L-2z 


(2,0) = Z 


4 i = : NTL 
89 + pet oe (=) 


So to satisfy 0(2,0) = f(a), we need to obtain the C,, as the Fourier 
sine series coefficients of the function 
g(x) = f(x) — (L— x)00/L — x61/L. 


Substituting these into equation (*) gives the required result. 


Solution to Exercise 14 
(a) Set A(z, t) = X(x) T(t). Then 
070 00 
_——_- = XT d = XT. 
Ox? BE 
(b) Equation (70) becomes 
XT’ = DX"T — yXT, 
and dividing by XT gives 
Ty! xX 
= pees 
ii x! 
Thinking a step ahead, we soon need to solve a differential equation 
for X (xz). To make this equation as simple as possible, we make a 
rearrangement to get 


x! il T! 
Fable): 


The left-hand side is a function of x alone, and the right-hand side is 
function of t alone, so both must be equal to the same constant py (the 
separation constant). We therefore get the ordinary differential 
equations 


X"—pX=0, TT’ =(Du— )T. 


Solutions to exercises 


The Fourier sine series 
coefficients are found using the 
odd periodic extension of g(x). 
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Solution to Exercise 15 

The relevant differential equation is 
T’ =(Du—y)T. 

For a particular value of n, this takes the form 
T’ = —(Dk +4)T, 

which has general solution 
Tn (t) = Om exp(—(Dk2 +9)t) 


222 
non 
= Qn exp | (oor +7) J » MWH=1,2,3, 2.45 
where @,, is an arbitrary constant. 


Solution to Exercise 16 


The required partial derivatives are calculated using the chain rule: 


Ou Ou 

—-=kA gl — = —kcA cos|k(x — 

Fa cos|k(x — ct)], ey cA cos[k(x — ct)], 

Oru 2s Pu 224 

aan —k* Asin|k(x — ct)], z= —k*c* Asin|k(a — ct)]. 
Substituting these partial derivatives into the wave equation gives 

Ou 1 du ia Lp pede ek 

a BOE —k* Asin|k(x — ct)| + a (k cAsin|k(x — ct)]) = 0, 


as required. So we see that Asin[k(a# — ct)] is a solution of the wave 
equation, for any values of k and A. 


Solution to Exercise 17 


The chain rule of differentiation gives 


Oc N r —22 ie 
ES eel a 1 eS |) Sa 
a (om (Fa) 2Di © 

Also, 
Oc 1 N a 
— S56 =e ("A + exp(—2x?/4Dt) x (a) 
ao 2 lap eee | ae 


i} ae x x? ih 
=-—-—C C= = = CG. 
2t 4Dt? ADt? ~—-2t 


Partially differentiating Oc/Ox with respect to x again, we get 
Oe x? 1 x? 1 
a ns hen 
a? «ADA 2Dt 4D?t2, 2Dt 


Taking all the derivatives in the diffusion equation onto the left-hand side, 
and substituting in the above results, then gives 


Oc 07¢ x? 1 x 1 
OE es ef oe he ee eh 
Ot Ox €: =) “ (i mi) = 


as required. 
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Introduction 


Introduction 


In this unit we have a final look at differential equations. We considered 
the solution of several types of first-order differential equation in Unit 2, 
including examples of non-linear equations. However, the other units 
devoted to differential equations considered only linear equations (in Unit 3 
we looked at linear constant-coefficient second-order differential equations, 
in Unit 6 we studied simultaneous linear ordinary differential equations, 
and in Unit 12 we considered linear partial differential equations). 


One reason for the emphasis on linear differential equations is that 
non-linear equations are difficult to solve. Usually they do not have a 
solution that can be expressed in terms of standard functions. But these 
equations arise in many interesting investigations in science, engineering 
and economics. It is therefore important to be able to understand their 
solutions. This unit describes approaches that give approximate or 
qualitative information about solutions, rather than trying to find the 
solution itself. This information may be in the form of a diagram or an 
approximate expression. In practice numerical solutions using a computer 
are also used, but they are outside the scope of this module. 


In this unit we consider pairs of first-order non-linear differential equations 
involving two variables. All of the models that appear in this unit can be 
represented as pairs of differential equations of the form 


dx dy 
ald pit 1 
dt u(x, y), dt u(x, y), (1) 


where the functions u and v depend on x and y but not on t. Systems of 
this form, where t does not appear explicitly in the right-hand side, are 
said to be autonomous (and conversely, if the equations contained 
functions such as u(z,y,t) and v(x, y,t), they would be described as 
non-autonomous). 


In this unit we use examples relating two interacting populations of 
animals, one a predator and the other its prey. An example is given by the 
Lotka-—Volterra pair of equations 


L=he (1 — Z) , yo=-hy (1 — =) : (2) These equations are non-linear 
Y x because of the xy terms on the 
where h, k, X and Y are known positive constants, and « = x(t) and right-hand sides. 


y = y(t) represent the two population sizes at time t. A derivation of the 
Lotka-Volterra equations will be given in Section 1. 


While describing populations of animals is a vibrant area of science, a 
more typical application of non-linear differential equations is to describe 
the motion of mechanical systems. Such systems can range in complexity 
from a stone launched by a slingshot to a system of planets and asteroids 
orbiting a star. This unit will discuss the motion of a rigid pendulum as a 
simple example of a mechanical system. 
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The equation of motion for the undamped motion of a rigid pendulum is 
the second-order differential equation 


This equation is non-linear #+w* sing = 0, (3) 


because of the sin term. 
7 ictal where w is a constant and x = 2(t) is the angle in radians that the 


pendulum makes with the downward vertical at time t. As might be 
expected, this equation is in the form of Newton’s second law, ma = F(z) 
(where the force is F(a) = —mw* sinx). But equation (3) does not appear 
to be in the same form as equations (1). To make the connection clear, 
consider the following system of equations: 


t=y, y= —w’sing. (4) 


Note that this pair of differential equations is in the form of equations (1), 
with u(z,y) = y and v(x, y) = —w* sina. Also, observe that if you 
differentiate the first equation of (4) and substitute in the second, you 
recover equation (3). There is a general principle here: you can convert a 
single second-order differential equation into two coupled first-order 
equations of the form of equations (1). By means of this approach, the 
methods developed in this unit can also be applied to second-order 
differential equations. 


Non-linear equations and chaos 


Sometimes non-linear differential equations have solutions that are 
relatively easy to understand, even if you cannot find an exact 
mathematical expression. For example, a set of equations such as (1) 
may have solutions in which x(t) and y(t) approach an equilibrium 
point (also known as a fixed point), so that x(t) > X and y(t) > Y as 
t > oo, for two constants X and Y. 


Non-linear equations may also produce complicated and apparently 
erratic behaviour that defies conventional mathematical descriptions. 
An example is shown in Figure 1. This is a plot of a solution of a 
system of three coupled first-order differential equations, called the 
Lorenz equations: 


&=oa(y—2), U— tp —2) —y, z= xy — Bz, (5) 
where the constants are o = 28, p = 10 and 8 = 8/3 in this case. 


This type of motion is called chaotic. The solution (x(t), y(t), z(t)) 
spends most of the time spiralling around two surfaces, but it 
occasionally jumps between these surfaces. Despite the fact that the 
equation of motion is known precisely, these jumps occur at times 
that are very hard to predict. The possibility that simple systems of 
differential equations could produce highly unpredictable motion was 
not widely appreciated until late in the twentieth century. 
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This discovery has had a profound influence on research in the 
sciences, and has stimulated the development of a new mathematical 
discipline called dynamical systems theory. 


Figure 1 A solution of the Lorenz equations (5), obtained using a 
computer; as t increases, the solution (x(t), y(t), z(t)) follows a 
trajectory that cannot be described by standard mathematical 
functions 


To see examples of chaos, you need to have more than two variables 
(as in equations (5)), or you need to consider non-autonomous 
equations. Although chaos does not occur in solutions of 

equations (1) for any choice of the functions u and v, the methods 
developed in this unit can also be applied to analyse chaotic motion. 


For equations of form (1), we consider the paths defined by((t), y(t)) in 
the xy-plane. A very powerful approach starts out by seeking a constant 
solution (which describes an equilibrium state of the system). For 
example, the Lotka-Volterra equations (2) have a constant solution 

x(t) = X, y(t) = Y, which describes a situation where the two populations 
are in equilibrium. Near such a solution, you will see that some useful 
information can be obtained by replacing the original non-linear equations 
by linear approximations to the differential equations. The equilibrium 
states and the behaviour of the system when it is nearly in equilibrium 
play a major part in obtaining a qualitative overview of the behaviour of 
the model. This approach of determining equilibrium points or fixed points 
of a non-linear system, and then using linearised equations to study motion 
in the neighbourhood of equilibrium points, is the most powerful available 
tool for analysing systems of non-linear differential equations. 


Introduction 


We use the notations x or x(t), 
& or «(t), etc., interchangeably 


to suit the context. 
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This model was originally 
discussed in Unit 2. 
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Study guide 


We begin in Section 1 with the Lotka—Volterra equations, which apply to a 
pair of interacting populations. In Section 2 we see how these equations 
can be linearised (that is, approximated by linear equations) near an 
equilibrium state. The resulting system of linear differential equations was 
discussed in Unit 6, but here, in Section 3, we use graphical 
representations of the solutions near an equilibrium state to get qualitative 
information about solutions of the original non-linear equations. Section 4 
looks at models for the motion of a rigid pendulum: second-order 
differential equations are transformed to systems of first-order equations, 
and the techniques developed earlier in the unit are applied to find and 
interpret graphical solutions. 


You need to be familiar with the techniques developed in Unit 5 for finding 
eigenvalues and eigenvectors, and in Unit 6 for the solution of systems of 
first-order linear differential equations. 


1 Modelling populations of predators 
and prey 


In this section we develop models for populations of a predator and its 
prey. A predator population depends for its survival on there being 
sufficient prey to provide it with food. Intuition suggests that when the 
number of predators is low, the prey population may increase quickly, and 
that this will eventually result in an increase in the predator population. 
On the other hand, a large number of predators may diminish the prey 
population until it is very small, and this will eventually lead to a collapse 
in the predator population. Our mathematical models will need to reflect 
this behaviour. 


It is not possible to find exact solutions to all such models, so we will 
introduce you to a geometric approach, based on the notion that a point 
(x,y) = (a(t), y(t)) in a plane may be used to represent two populations 

x = x(t) and y = y(t) at time t. As t increases, the point (a(t), y(t)) traces 
out a path that represents the variation of both populations with time. 


1.1 Exponential growth of a single population 


Before we consider a system of two interacting populations, we first 
develop a simple continuous model of the growth of a single population, 
which is called the exponential model. This allows us to develop some basic 
concepts of population models in a simple context. 


We model the population size x, which we usually simply refer to as the 
population x (omitting the word ‘size’), as a function of time t. This 
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function cannot take negative values (since there are no negative 
populations), but we allow it to take the value zero. We normally assume 
that ¢t is measured in years. We deal with a continuous model, rather than 
a discrete one, so the derivative « = dx/dt represents the rate of increase of 
the population, which we often refer to as the growth rate (even though 
when « < 0 it actually represents a decay rate). 


In the exponential model, we make the assumption that the growth rate « 

is proportional to the current population x. (This means that if the growth 
rate is 20 per year when the population is 100, then the growth rate will be 
40 per year when the population is 200, the growth rate will be 60 per year 
when the population is 300, and so on.) This assumption leads directly to 

the differential equation 


(ae = 0}, (6) 


where k is a constant. If k is positive, then x is an increasing function of 
time, while if & is negative, then x is a decreasing function of time. 


ta=kax 


Exercise 1 


Under what circumstances is it reasonable to assume that the growth rate 
of a population is proportional to the current population? (This is an 
open-ended question that is primarily about modelling rather than 
mathematics.) 


Equation (6) can be solved explicitly. Choosing a value for the population 
at time t = 0, for example x(0) = 20, gives the solution 


a(t) = ape" (ap > 0). (7) 


The nature of this solution depends on the sign of the constant k. If k = 0, 
the population remains constant in time. If & > 0, the population increases 
exponentially, and if k < 0, the population decreases exponentially. The 
two situations shown in Figure 2 are described, respectively, as exponential 
growth and exponential decay (although we could also say that the latter 
exhibits ‘negative growth’). For this reason we refer to equation (6) as the 
exponential differential equation, or, when applied to a population, 
the exponential model. 


The proportionate growth rate i/z represents the rate of increase of 
the population per unit of the current population, and may be considered 
as the difference between the birth and death rates per head of population. 
It may be positive (for a growing population in which the birth rate 
exceeds the death rate), negative (for a declining population in which the 
death rate exceeds the birth rate) or zero (for a static population in which 
the birth and death rates are equal). In the case of the exponential 

model (6), we have «/x = k, so the proportionate growth rate is constant. 
(We previously assumed that x > 0. While talking about proportionate 
growth rate, we exclude the possibility that x takes the value zero.) 


A population x can take only 
integer values, so we say that x 
is a discrete variable. Here, 
however, we approximate the 
population by a variable that 
can take any real value, referred 
to as a continuous variable. 


z= ae, k <0 


+Yv 


0 
(b) 


Figure 2. Behaviour of a 
population modelled by 
equation (7). For k > 0 there 
is exponential growth, and for 
k <0 there is exponential 
decay. 
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x is the prey population; 
y is the predator population. 


Figure 3. A phase path in 
phase space 
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Exercise 2 


Can you suggest any reason why, in the case k > 0, the assumption that 
the proportionate growth rate «/x is a constant is unrealistic for real 
populations? 


The exponential model is fairly accurate for many populations in a state of 
rapid increase, but it is reasonable only over a restricted domain of time. 
As a model of the behaviour of increasing populations over longer periods 
of time, the exponential model is clearly unsatisfactory because it predicts 
unbounded growth. In Unit 2 we mentioned one way of addressing this 
deficiency when we considered the logistic equation: this allows for the fact 
that the rate of population growth decreases as the population increases, 
due to competition for resources. However, in this unit we now adopt a 
more sophisticated approach by explicitly including variables representing 
the populations of two species, a population and its prey. 


1.2 Motion in phase space 


In the rest of this section we will be concerned with developing models for 
populations of rabbits (the prey) and foxes (the predators). Our purpose is 
to determine how these populations evolve with time. At a particular 

time t, we suppose that these populations are x(t) and y(t), respectively. 
Before discussing the differential equations that determine these functions, 
we introduce some geometrical language that will help us to discuss 
equations of motion written in the form (1). 


At any given time, we represent this system by a point in the xry-plane. 
We call this two-dimensional space the phase space (or phase plane) for 
the system, and the point is called the phase point. We can think of x 
and y as the coordinates of the position vector x of the phase point. The 
evolution of the two populations can then be represented by a path, called 
a phase path (or phase trajectory), in the phase space, as shown in 
Figure 3. Here, the direction of the arrows indicates the direction in which 
the phase point (x(t), y(t)) moves along the phase path with increasing 
time. However, this type of representation does not show how quickly or 
slowly the point moves along the path. 


The position of the phase point at time t is represented by the column 
vector 


Oa aE 


and the corresponding velocity of the phase point is 
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The functions u(x, y) and v(x, y) can be regarded as representing a vector 
field 


acon = [22 


v(x, y) 


and equations (1) can then be written in the vector form 


= We, 9). (8) 
This is an equation of motion for the phase point: the velocity of the phase 
point, x, is equal to u(x), that is, to the value of a vector field u evaluated 
at the position of the phase point x = (x,y). As the phase point moves 
along the phase path, the velocity x of the phase point is always tangential 
to the phase path. We therefore reach the following conclusion. 


The vector field u(x, y) is tangential to the phase path at (a, y). 


This geometrical concept is a powerful method for getting insight into the 
behaviour of systems of differential equations that cannot be solved exactly. 


Multiple meanings of phase 


The word ‘phase’ crops up in many different areas of science with no 
obvious connections. In this unit we have defined phase point, phase 
path and phase space. In Unit 3 we wrote an equation for an 
oscillation in the form x(t) = Asin(wt + ¢), and referred to ¢ as the 
phase constant of the oscillation. In physics and chemistry you will 
also find discussions of phase transitions, which are abrupt changes of 
the properties of a substance in response to changes of temperature. 
Don’t seek a deep connection: there isn’t one. 


The word phase is derived from a Greek word with a meaning similar 
to ‘appearance’, so it is natural that it was adopted independently by 
different branches of science. Its use in discussing oscillations arose 

from the fact that the phases of the moon are a periodic phenomenon. 


1.3 A first predator-prey model: sketching phase 
paths 

In our mathematical models of rabbit and fox populations we make the 

following assumptions. 

e There is plenty of vegetation for the rabbits to eat. 

e The rabbits are the only source of food for the foxes. 


e An encounter between a fox and a rabbit contributes to the fox’s 
larder, which leads directly to a decrease in the rabbit population and 
indirectly to an increase in the number of foxes. 


In this context, the term vector 
field simply means a field with 


two components. 


More sophisticated models also 


take account of the fact that 
there is a time delay for the 


population to increase due to 


animals breeding, or for the 


population to decrease due to 


starvation. 
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When t = 0, x = Zo. 


An exception, which we discuss 
later, occurs when & = y = 0 at 
(Xo, Yo), SO U(%o, yo) = O and 
there is no tangent vector to 
follow. 
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We may, for convenience, measure the populations in hundreds or 
thousands, as appropriate, so that we are able to use quite small numbers 
in our models. The population of rabbits will be described by a function 
x(t), and the population of foxes by y(t). 


We begin with a very simple model for the two populations; this generalises 
the exponential model of the previous subsection, which applies to a single 
population. Our simple model has the advantage that we can easily find an 
explicit solution, and this will help us to explore the geometric approach. 


As a first model, we assume that the populations are evolving 
independently (perhaps on separate islands). Because there are no 
interactions, the populations may be modelled by the pair of equations 


b=ke, y=—hy («>0, y>0), (9) 


where & and h are positive constants. The conditions « > 0, y > 0 in 
parentheses apply here, as well as in similar situations throughout the unit, 
to the first equation « = kx, as well as the second equation y = —hy. 


The first equation models a colony of rabbits not affected by the predation 
of foxes, growing exponentially according to a rule of the form 


a(t) = aoe", (10) 


where 20 is a positive constant representing the initial rabbit population at 
t= 0. 


Exercise 3 


Determine a formula for the population y(t) of foxes. How would you 
interpret this solution for the population of foxes? 


Equations (9) form a system of linear differential equations similar to those 
that you met in Unit 6. Let us now consider the solution of these 
equations from the geometrical viewpoint of motion in phase space, which 
we discussed above. Using vector notation, the pair of populations may be 
represented by the vector x = [x y]’. The system of equations (9) then 
becomes the vector equation 


& ka 
x= [fF] =u = |_F] (uy 
Recall also that u(x, y) is tangential to the phase path describing a 
particular solution of x = u(z,y) at the point (x, y). 


This suggests a geometric way of finding a particular solution of 

equation (11). On a diagram, we draw a selection of arrows representing 
the directions of the vector field u(x, y) at a selection of points (a, y). 
Since the magnitudes of u(x, y) may vary considerably and so make the 
diagram difficult to interpret, we often use arrows of a fixed length. Then, 
choosing a particular starting point (xo, yo), we follow the directions of the 
arrows to obtain a phase path corresponding to a particular solution. 
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To see how this works, consider equation (11) with k = 1 andh=1. In 
this case the vector field u(z, y) is given by 


x 

u(x, y) |? : 
Figure 4 shows the directions of this vector field at a selection of points in 
the xy-phase space. For example, the red arrow centred at x = 1, y= 3 
points in the direction of [1 —3]", while the blue arrow centred at 
x = 3, y =1 points in the direction of [3 —1]". The phase path at any 
point (2, y) is tangential to u(z, y), so the continuous curve in Figure 4 is a 
reasonable estimate of a phase path representing a particular solution of 
equation (11) (with k = h = 1). This phase path is in broad agreement 
with the results of equation (10) and Exercise 3: it shows that a decrease 
in y (the fox population) is accompanied by an increase in x (the rabbit 
population). 


The methods that we have just used to analyse a simple population model 
can be applied more generally. To explore these methods, we now widen 
the discussion and look at similar systems that do not arise from 
populations. In this broader context, we allow x and y to take positive or 
negative values. 


Example 1 
(a) Using arrows of a fixed length, sketch a map of the vector field 


wen [23 


for —-4<a2<4and —4<y <4. Sketch a few phase paths for various 
initial conditions. 


Write down the system of differential equations x = u(x) 
corresponding to this vector field. Find the general solutions of this 
system of equations, and hence obtain an equation for y in terms of x 
for each path in the xry-plane represented by this general solution. 


(c) Use your answer to part (b) to sketch a sample of the paths in the 
zry-plane that represent typical particular solutions. 


(d) 


Comment on the relationship between the vector field map in part (a) 
and the phase paths sketched in part (c). 


Solution 


(a) We use values of u(x, y) to construct Figure 5. For example, the red 
arrow at x = 1, y = 1 points in the direction of [0.2 0.3]", while the 
blue arrow at x = —2, y = 3 points in the direction of [—0.4 0.9]. In 
each case, the arrow at (x,y) represents a vector of a fixed length 
parallel to u(z,y), and therefore indicates the direction of a phase 
path through the point (x,y). A few phase paths have been 
(tentatively) sketched on this diagram. 


ul WANN 
of \YNSN 
2-| \ \ ae 
| MS, ae 


Figure 4 A map of the 
vector field u(x, y) for 
equation (11) withk =h=1 
(x > 0, y 2 0) 


It is time-consuming to draw 
vector field maps by hand, but 
computers can help. The 
subsequent sketching of phase 
paths is not a precisely defined 
process, and different people 
may get slightly different results. 
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The modulus sign around x 
ensures that we do not try to 
obtain the square root of a 
negative number. The 
arbitrariness of K ensures that 
the equation represents all 
possible cases. 
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Figure 5 A map of the vector field and some phase paths 


(b) We have 
L 0.2% 
vo-f] (3) 
so the system of equations is 
S=025, y=U.3y. 


(c) 


Each of these equations can be solved separately. The general 
solutions are 


0.2 


x(t) = age", y(t) = yoe?™. 


To obtain the equation for the paths in the form of a function y(x), we 
must eliminate t from x = age?! and y = yoe®*". 


Cubing the first equation and squaring the second gives x? = mee & 


and y? = ae so aa = y/ya- Hence the equations of the paths 
are of the form 
y= Klee, 
for some constant K. 
As we have been able to find the equations of the paths in part (b), 


namely y = K|2x|?/2, we can use these to sketch the phase paths in the 
xry-plane. These are shown in Figure 6. 


SMA LA 
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Figure 6 Phase paths superimposed over the vector field 


The arrows on these paths indicate the direction of motion as time 
increases, and may be determined as follows. 


The first of the differential equations is ¢ = 0.2%. So for positive « we 
have « > 0, and z is an increasing function of time. Therefore in the 
right half-plane, the arrows on the paths point to the right. Similarly, 
for negative x we have « < 0, and z is a decreasing function of time. 
Hence the arrows on the paths point to the left in the left half-plane. 
(Consideration of the second differential equation, y = 0.3y, confirms 
the directions of the arrows on the paths.) The arrows on the paths 
along the positive and negative y-axes can be deduced from 
consideration of the differential equation y = 0.3y. Note that the 
origin is also a path, corresponding to K = 0, but it has no time arrow 
associated with it. 


The vector field u(z,y) is tangential at (2, y) to the phase path 
passing through (x,y). The arrows in Figure 6 show the directions of 
the vector field at an array of points. We should therefore expect the 
direction of an arrow at (x,y) to be close to the direction of any phase 
path that passes close to (x,y). This expectation is borne out by the 
arrows and phase paths in Figure 6. The tentative paths sketched in 
Figure 5 are close to the exact paths in Figure 6. 
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A source can occur at a point 
other than the origin. 


Sy 


Figure 7 A sink at a point 
other than the origin 


This is the equation for our first 
model for the predator—prey 
populations (equation (11)) with 
k=1 and h=1, but without 
the restrictions z > 0, y > 0. 
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Given a vector map of arrows at a closely-spaced set of points, it is 
possible to sketch the general form and directions of phase paths passing 
near these points. A diagram showing a selection of these phase paths in 
the phase plane is called a phase diagram. The significance of such a 
diagram is that each of the phase paths corresponds to a particular 
solution of the system of equations. 


Before we leave Example 1, you may have noticed in Figure 6 that the 
paths radiate outwards from the origin in all directions. For this reason, 
we refer to the origin as a source. 


We now look at the phase paths for a similar system, for which 


ia = —0.22 
Y= 1 _g gy] 
This system behaves in a similar fashion to the system in Example 1. The 
general solution is 


=a 


(12) 


g= ager, 


Eliminating t gives 
g= Kia, 


as before. However, in this case, as t increases, the direction of motion 
along the phase paths is the opposite to that in Example 1. At any point 
(x,y), the vector field [—0.22, —0.3y]? has the same magnitude but the 
opposite direction to the vector field [0.2 0.3y]". The phase diagram is 
therefore identical to Figure 6 except that the directions now point towards 
the origin. In a case like this, the origin is said to be a sink. 


Sources and sinks need not always be at the origin. In general, if all the 
phase paths in the vicinity of any point P radiate outwards from P, then 
P is a source, and if all the phase paths in the vicinity of P converge 
inwards towards P, then P is a sink (see Figure 7). 


Exercise 4 


Write down the system of differential equations x = u(x, y) given by the 
vector field 


x 
u(e,u) = |_3). 
Find the general solution of this system of equations. Hence find an 
equation for y in terms of x for the phase paths in the xy-plane 
represented by this solution. Sketch some of these paths. Do any of the 
paths include the origin? 


The phase diagram for the vector field examined in Exercise 4 is shown in 
Figure 8. You can see that the vast majority of paths do not radiate into 
or out of the origin. On these paths, a point initially travels towards the 
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origin, but eventually travels away from it again. The only paths that 
actually radiate inwards towards, or outwards from, the origin are those 
along the x- and y-axes. In this case we call the origin a saddle (because 
the phase paths resemble contour lines near a saddle point). 


Note that the model described by equations (9) has phase paths in the 
form of a saddle, because the coefficients have different signs. The 
behaviour of the populations of rabbits and foxes illustrated in the 
quadrant x > 0, y > 0 of Figure 8 is what we would expect from our first 
model. The population x of rabbits increases without limit, as they are 
isolated from their predators. On the other hand, the population y of foxes 
decreases to zero, as they have no access to their sole source of food. 


1.4 A second predator—prey model 


In the previous subsection we looked at a simple model for rabbit and fox 
populations when there was no interaction between the two populations. 
This model may be reasonable when both species inhabit the same 
environment but with population sizes that are so small that the rabbits 
and foxes rarely meet. As we saw, for initial positive populations, this first 
model predicts that rabbits will increase without limit and foxes will die 
out. However, this is not what we expect for interacting populations, when 
encounters are inevitable. 


In this subsection we look at a revised model, based on the assumption 
that the number of encounters between foxes and rabbits is proportional 
both to the population x of rabbits and to the population y of foxes. In 
addition to the assumptions listed at the beginning of Subsection 1.3, our 
revised model assumes that 


e the number of encounters between foxes and rabbits is proportional to 
the product xy. 


For a population x of rabbits in a fox-free environment, our first model for 
population change was given by the equation + = kx, where k is a positive 
constant. This represents exponential growth. However, if there is a 
population y of predator foxes, we should expect the growth rate « of the 
rabbit population to be reduced. A simple assumption is that 


e the growth rate « of the rabbit population decreases by a term that is 
proportional to the number of encounters between rabbits and foxes, 
i.e. by a term proportional to xy. 


We revise our first model to include this extra term, so the differential 
equation that models the population x of rabbits is now 


t=kx— Ary, 


for some positive constant A. As you will see later, it is convenient to write 
A=k/Y, for some positive constant Y, giving 


i= ke (1-3). (13) 


Figure 8 Phase paths near a 
saddle, discussed in 
Exercise 4 


In a period of time dt, the 
change in the rabbit population 
is the number kz 6t of additional 
rabbits born (taking into 
account those dying from 
natural causes) minus the 
number Azy ot of rabbits eaten. 
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As for equations (9), the 
conditions « > 0, y > 0 apply to 
both differential equations. 
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Similarly, for a population y of foxes in a rabbit-free environment, our first 
model for the population change is given by the equation y = —hy, where 
h is a positive constant. This represents exponential decay. However, if 
there is a population x of rabbits for the foxes to eat, we should expect the 
growth rate y of the fox population to increase. A simple assumption is 
that 


e the growth rate y of the fox population increases by a term that is 
proportional to the number of encounters between foxes and rabbits, 
i.e. by a term proportional to xy. 


Our revised model for the foxes is given by 
y = —hy + Bay, 


for some positive constant B. Again, it is convenient to write B= h/X, 
for some positive constant X, so that this equation becomes 
x 
j=—h (1 2 =) 14 
y y 7 (14) 


Together, the differential equations (13) and (14) model the pair of 
interacting populations. 


Exercise 5 


Use equations (13) and (14) to sketch the graph of the proportionate 
growth rate «/x of rabbits as a function of the population y of foxes, and 
the graph of the proportionate growth rate y/y of foxes as a function of 
the population x of rabbits. Interpret these graphs. 


Equations (13) and (14) provided one of the first applications of 
mathematical models to biological ecosystems. They were proposed 
independently by the American biophysicist Alfred Lotka (in 1925) and by 
the Italian mathematician Vito Volterra (in 1926), and they are called the 
Lotka—Volterra equations. 


The Lotka—Volterra equations 


The evolution of two interacting populations x and y can be modelled 
by the Lotka—Volterra equations 
3 | A x 
=i (1-3), == (a-<) >0, y > 0), 15 
& = kx wile y x) 29 y20) (15) 
where x is the population of the prey, y is the population of the 
predators, and k, h, X and Y are positive constants. 


The Lotka—Volterra equations are non-linear because their right-hand 
sides contain a term proportional to xy. 


1 Modelling populations of predators and prey 


The Lotka-Volterra equations can also be written as 


x= u(z,y), 
where x = [@ y]’ and the vector field u(2, y) is given by 
ka (1 — Z) 
Y 
ieay= : (16) 
-w(-$ 
Exercise 6 


Suppose that in equations (15), k = 0.05, h = 0.1, X = 1000 and Y = 100. 
Find the values of the corresponding vector field u(x, y) at the following 
points. 


(a) (0,0)  (b) (0,100) — (c) (500,100) — (d) (1000, 0) 
(e) (1000,100) — (f) (1500,100) — (g) (1000,50) (bh) (1000, 150) 


Previously, we were able to find exact solutions for the pairs of differential 
equations that arose from our mathematical model, but for the 
Lotka—Volterra equations (15), no explicit solutions for x(t) and y(t) are 
available. We will therefore rely on geometrical arguments, based on vector 
field maps in the phase plane. For the parameters and (x,y) points given 
in Exercise 6, we can begin to construct a vector field map, as shown in 
Figure 9, where we have used arrows of fixed length. 


YA 


(a) (d) 
0 T —> T il 
500 1000 1500 a 


Figure 9 Directions of the vector field u(z,y) for the Lotka—Volterra 
equations as calculated in Exercise 6 


Figure 10 continues this process by adding more arrows. 
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Figure 11 A phase path 
consistent with Figure 10 
might spiral in to the fixed 
point 
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Figure 10 Directions of the vector field u(z, y) for the Lotka—Volterra 


equations at many points 


From this arrow map we can try to sketch some phase paths. Figure 11 
shows one such attempt, which corresponds to a guess at a particular 
solution of the equations. In Figure 11 we have labelled a point A on a 
path, which can be taken as the initial value for a particular solution. 
Some other points have been marked to aid the following discussion. To 
interpret this guess at a solution, we think about what happens to the 
values of the populations as we follow the dashed path. 


Initially, at the point A, there are 1000 rabbits and 50 foxes. As we follow 
the path, the rabbit population increases and so does the fox population, 
until at the point B we have reached a maximum rabbit population. As 
the fox population continues to rise, the rabbit population goes into 
decline. At C, the fox population has reached its maximum, while the 
rabbits decline further. After this point, there are not enough rabbits 
available to sustain the number of foxes, and the fox population also goes 
into decline. At D, the declining fox population gives some relief to the 
rabbit population, which begins to pick up. Finally, at E, the decline of 
the fox population is halted as the rabbit population continues to increase. 


While it is clear from the form of the vector field that we must return close 
to the point A, it is impossible to decide exactly what will happen from 
this geometrical picture. The path could ‘spiral in’, as illustrated in 
Figure 11, it could ‘spiral out’, or the phase path might close on itself 
exactly, in which case the cycle will repeat indefinitely. In fact, we will 
show later (in Subsection 3.5) that for the Lotka—Volterra equations, the 
paths close on themselves (so that the point F in Figure 11 is the same as 
point A). This implies that the populations for the Lotka-Volterra model 
are periodic functions of time. 


2 Equilibrium and stability 


Exercise 7 


Consider the Lotka—Volterra system of differential equations defined in 

equations (15), with k = 0.05, h = 0.1, X = 1000 and Y = 100, and with 

zr>0,y> 0. Recall that the Lotka—Volterra 
equations are defined only in the 


(a) For what values of x and y do the following hold? quadrant 2 > 0, y > 0. 


(i) ¢=0 (ii) ¢>0 ~ (iti) ¢ <0 

(b) For what values of x and y do the following hold? 
(i) y=0 (ii) y>0 ~~ (ili) <0 

(c) Using your answers to parts (a) and (b), and Figures 9 and 10, sketch 
some more phase paths representing solutions of the system of 


differential equations. You may assume that for the Lotka—Volterra 
model, paths that return close to the starting point are closed. 


2 Equilibrium and stability 


2.1 Equilibrium points 


Systems of differential equations such as (1) usually have solutions where 
both z(t) and y(t) are constant, taking values denoted x, and Ye, 
respectively. These solutions are known as equilibrium or fixed point 
solutions. A particular solution (a(t), y(t)) may or may not approach 

(e, Ye) as t — 00; this depends on the stability of the equilibrium point. 
But equilibrium point solutions are important because they are the most 
easily calculated property that gives quantitative information about a pair 
of non-linear differential equations. 


Examples of equilibrium points are the point (0,0) in Figure 8 and the 
point (1000, 100) in Exercises 6 and 7. The equilibrium point (1000, 100) As you will see later, the point 
corresponds to the fact that a rabbit population of 1000 and a fox (1000, 100) is an isolated point 


population of 100 can coexist in equilibrium, not changing with time. through which no phase path 
passes. 


More generally, if x(t) = C, y(t) = D is a constant solution of a system of 
differential equations, it follows that «(t) = 0, y(t) = 0, and we can use this 
property to find all the equilibrium points of the system. 


Definition 


An equilibrium point (or fixed point) of a system of differential 
equations 


ae a) 


is a point (%e, Ye) such that x(t) = re, y(t) = ye is a constant solution 
of the system of differential equations, i.e. (%e, Ye) is a point at which 
(C—O andy (GU: 
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Solving u(x, y) = 0 requires the 
solution of two simultaneous 
equations (generally non-linear) 
for the unknowns x and y. 


As stated earlier, h, k, X and Y 
are positive constants. 


This explains our choice of 
constants X and Y in 
Subsection 1.4. 
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Procedure 1 Finding equilibrium points 

To find the equilibrium points of the system of differential equations 
x = u(x, y), 

for some vector field u, solve the equation 
u(z,y) = 0, 


for x and y. If the variables x and y represent populations, they must 
satisfy the conditions x > 0 and y > 0. 


Example 2 


Find the equilibrium points for the Lotka—Volterra equations (15) for 
rabbit and fox populations. 


Solution 


Using Procedure 1, we need to solve the equation u(2,y) = 0, which 
becomes 


ke (1~ ¥) _ fo 
Pease 


This gives the simultaneous equations 


ka (1- 2) =0, 


_hy (- =) =i), 


From the first equation, we deduce that either « = 0 or y=Y. 


If x = 0, the second equation reduces to —hy = 0, so y = 0 and hence (0, 0) 
is an equilibrium point. 


If y = Y, the second equation becomes —hY (1 — 2/X) =0, so x = X and 
hence (X,Y) is an equilibrium point. 


Thus there are two possible equilibrium points for the pair of populations. 
The first has both the rabbit and fox populations as zero, i.e. the 
equilibrium point is at (0,0); there are no births or deaths — nothing 
happens. However, the other equilibrium point occurs when there are 

X rabbits and Y foxes, i.e. the equilibrium point is at (X,Y), when the 
births and deaths exactly cancel out and both populations remain 
constant. 


2 Equilibrium and stability 


Exercise 8 


Suppose that the population x of a prey animal and the population y of a 
predator animal evolve according to the system of differential equations 


£=0.1le—0.005ry, y=—0.2y+0.00042y (x >0, y> 0). 


Find the equilibrium points of the system. Put these equations in the 
standard form of the Lotka—Volterra equations. 


Exercise 9 


Suppose that two interacting populations x and y evolve according to the 
system of differential equations 


£=2(20-—y), y=yl0-y)(10-—2z) («>0, y>0). These are not Lotka—Volterra 


Find the equilibrium points of the system. eATaniOnS 


2.2 Dynamics close to equilibrium 


In a real ecosystem it is unlikely that predator and prey populations are in 
perfect harmony. What if equilibrium is disturbed by a small deviation 
caused perhaps by a severe winter or hunting? If the number of rabbits is 
reduced, there would be a decreased food supply for the foxes, and the 
population of foxes could decrease to zero as a consequence. On the other 
hand, if the number of foxes is reduced, the birth rate for rabbits would 
then exceed their death rate, and the number of rabbits could increase 
(perhaps without limit in a simplified model). 


If a small change or perturbation in the populations of rabbits and foxes 
from their equilibrium values, for no matter what reason, results in 
subsequent populations that remain close to their equilibrium values, then 
we say that the equilibrium point is stable. On the other hand, if a 
perturbation results in a radical change, with, for example, the population yA 
of foxes or rabbits increasing without limit, then we say that the 
equilibrium point is unstable. 


If you look at the phase diagram in Figure 12, where the origin is a sink, 
you can see that any slight perturbation from the origin will result in a 
phase point that returns to the origin as time increases. So the point (0,0) 
is a stable equilibrium point. 


Sv 


On the other hand, the origin in the phase diagram shown in Figure 6 isan Figure 12 Phase paths close 
unstable equilibrium point. Any perturbation away from the origin will to a sink, which is a stable 
result in the phase point travelling further and further away from the equilibrium point 

origin with time. Similarly, the origin in the phase diagram shown in 

Figure 8 is an unstable equilibrium point. Apart from increases or 

decreases in y with x unchanged, any perturbation will result in a point 

that travels further and further away from the origin with time. 
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The stability of equilibrium points 
Suppose that the system of differential equations 
x = u(z,y) 


has an equilibrium point at 7 = %e, y = ye. The equilibrium point is 
said to be: 


e stable if all points in the neighbourhood of the equilibrium point 
remain in the neighbourhood of the equilibrium point as time 
increases 


e unstable otherwise. 


Exercise 10 


Classify the equilibrium points (0,0) shown in the following phase 
diagrams as stable or unstable. 


VA YA Yy 


(a) (b) (c) 


2.3 Linearised equations of motion 


In general, non-linear systems of differential equations are hard to solve, 
and it may be impossible to find exact solutions. However, we are often 
interested in situations where the system is close to an equilibrium point. 
In this case, it is sensible to approximate the non-linear equations by a 
suitable set of linear differential equations, which can be analysed by the 
methods of Unit 6. 


We have another motive for finding linear approximations. In the next 
section you will see that there is a systematic way of investigating whether 
equilibrium points are stable or unstable. This method applies most 
directly to linear systems of equations. For a non-linear system, such as 
the Lotka—Volterra equations, a preliminary step is needed: we must first 
find linear approximations to the non-linear system that apply close to the 
equilibrium points. This subsection explains how this is done. 


If (%e, Ye) is an equilibrium point, consider small perturbations p and q 
from &_ and ye, giving new values x and y defined by 


Y=Vetq. (17) 


We can find the time development of the small perturbations p and q by 
linearising the differential equation x = u(z, y). We will make use of 
Taylor polynomials to achieve this. 


L=Iet+Dp, 


In order to do so, we must write each component of the vector field u(z, y) 
as a function of the two variables x and y: 


oe) 


At the equilibrium point (Xe, ye), we have u(Ze, Ye) = O, i.e. 
U(Le, Ye) =0 and Ul Pes Ye) = 0. 
Now, for small perturbations p and q, we can use the linear Taylor 
polynomial for functions of two variables to approximate each of u(x, y) 
and u(x, y) near the equilibrium point (ae, ye). We have 
Ou Ou 
U(Ze + DP; Ye ar q) = U(ZLe, Ye) +p Bq (ter Ye) +q By (er Ye) 
an \4 ua 
=P az,\"e, 5B, (Yer ) 
Pp an Ye qd ay e) Ye 
since u(Xe, Ye) = 0. Also, 
Ov Ov 
U(Ze + P, Ye + G) & U(Le, Ye) + P By (ter Ye) + q Bye Ye) 
ay ee ae 
= A \e, a \Le; Ve); 
Pp Ag Ye q ay er Ye 


since u(2e, Ye) = 0. 


The above two equations may appear rather unwieldy, but are much more 
succinctly represented in matrix form: 


ay [aelterte) (ter) 
veal = 2 es an ‘i 


Since x(t) = x. + p(t) and y(t) = ye + q(t), we also have 
t=3, 9=4 

Putting the pieces together, by substituting in x = u(z, y), gives a system 

of linear differential equations for the perturbations p and q: 


Ou Ou 
F 7 Dy (ter Ye) By (er Be) A as) 
i] | Ov Ov : 
41 |Z (@ete) a —(t0sye) | 

Or er, ge Oy e, ve 


An example will help to make this clear. 


2 Equilibrium and stability 


Although a population x or y 
cannot be negative, a 
perturbation p or qg can (usually) 
be negative if the population is 
less than the equilibrium value. 


0 
Note that (xe, Ye) means the 


. U : 
same thing as ap je. 
T=Le, Y=Ve 
it is the partial derivative Ou/Ox 
evaluated at the point 


(x, y) = (Le, Ye).- 
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Example 3 


For the Lotka-Volterra equations (15), determine the linearised equations 
that describe perturbations p and q from the equilibrium point (X,Y). 


Solution 
For the Lotka—Volterra equations we have 
Y 
; =k (1 _ Z) ) 
u(x, y) £ v 
x 


v(x, y) = —hy (1 — =) ; 


First we compute the partial derivatives, obtaining 


Ou (1-4) Ou _ ka 


Ox y Oy y’ 
ae B78): 
Evaluating these at the point (X,Y) gives 
SH(x,Y) =0, Se(K¥) = 5S, 

S(x,¥) = AE S(X.Y) = 


Thus the required system of linear differential equations is 


lois “3°18 " 


which can be written as the pair of equations 


kX hy 


p= yf q- ye 


We have replaced a system of non-linear equations, for which we have no 
explicit solution, with a pair of linear equations that can be solved using 
methods introduced in Unit 6. We should expect the solutions of 

equation (19) to provide a good approximation to the original system when 
p and q are small (i.e. when the system is close to the equilibrium 

point (X,Y)). 


The matrix 


Ou Ou 
Ox Oy 
J(z,y) = a Me 
dx Oy 


is called the Jacobian matrix of the vector field 


aeale | . 


v(z,y) 


2 Equilibrium and stability 


The 2 x 2 matrix on the right-hand side of equation (18) is this Jacobian 
matrix evaluated at the equilibrium point (2, ye), so equation (18) can be 
written succinctly as 


p= J (Ze, Ye) P, 


where p=[p_ q]" is the perturbation from the equilibrium point (2¢, ye). 


Procedure 2  Linearising near an equilibrium point 
Suppose that the system of differential equations 
u(x, Hl 
<= ne) — 
(x,y) bes 
has an equilibrium point at 7 = re, y = Ye. 


1. Find the Jacobian matrix 


Ou Ou 
Ox Oy 
Sa) — pa ae 
dx Oy 


2. In the neighbourhood of the equilibrium point (Ze, ye), the 
differential equations can be approximated by the linearised form 


Ou Ou 
D Bq (ter Ye) By (er Be) D 
A = F The Jacobian matrix, evaluated 
q Ov Ov a at the equilibrium point, is the 


5g Ye) By te Ye) 


matrix of coefficients of the 
linearised system. 


where x(t) = x. + p(t) and y(t) = ye + g(t). 


Exercise 11 


Write down the linear approximations to the Lotka—Volterra 
equations (15) near the equilibrium point (0,0). 


Exercise 12 
Consider two populations modelled by the equations These equations were considered 
in E ise 9. 
é=2(20-y), y=y(l0—y)(10—2z) (4 >0, y>0). in Exercise 


Find the linear approximations to these equations near the equilibrium 
point (10, 20). 


We have reduced the discussion of the behaviour of a pair of differential 
equations near an equilibrium point to an examination of the behaviour of 
a pair of linear differential equations. In the next section we will use the 
techniques from Unit 6 to solve these differential equations. 
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Exercise 13 

Find the equilibrium point (2., ye) of the system of differential equations 
& = 3x + 2y —8, 
y=ux+4y—6. 


Find a system of linear differential equations satisfied by small 
perturbations p and q from the equilibrium point. 


Exercise 14 


Suppose that a pair of populations x and y can be modelled by the system 
of differential equations 


& = 0.52 — 0.000 0527, 

y = —0.ly + 0.0004ry — 0.01y? (x >0, y> 0). 
(a) Find the three equilibrium points of the system. 
(b) Find the Jacobian matrix of the system. 


(c) For each of the three equilibrium points, find the matrix form of the 
linear differential equations that give the approximate behaviour of the 
system near the equilibrium point. 


3 Classifying equilibrium points 


In the previous section you saw how a system of non-linear differential 
equations x = u(x,y) may be approximated near an equilibrium point by a 
linear system p = Ap, where A is the Jacobian matrix 


A= J(£e, Ye): 


In this section we develop an algebraic method of classification, based on 
the eigenvalues of this Jacobian matrix. The procedure for classifying an 
equilibrium point of a non-linear system will then be as follows. 


Classifying equilibrium points 
e Near an equilibrium point, approximate the non-linear system by 
a linear system. 


e Find the eigenvalues of the Jacobian matrix for these linearised 
equations. 

e Classify the equilibrium point of the linearised system using these 
eigenvalues. 

e Deduce (where possible) the behaviour of the original system in 
the neighbourhood of the equilibrium point. 


The linearised system of differential equations, which approximates the 
behaviour of the non-linear system in the neighbourhood of the 
equilibrium point, has the form 


A-(¢ JEL 


where p and gq are perturbations from the equilibrium point, and a, b, ¢ 
and d are constants. This is equivalent to the set of equations 


p= ap + bq, 
q = cp + dq. 


From Unit 6, we know that the general solutions of such equations are 
determined by the eigenvalues and eigenvectors of the matrix of 
coefficients, which in the present context is the Jacobian matrix evaluated 
at the equilibrium point. We will illustrate various kinds of behaviour that 
can arise, by examining some examples. First, we look at matrices with 
real eigenvalues of various signs, then we consider matrices with complex 
eigenvalues. A summary of all these cases is given in Subsection 3.3. 


3.1 Matrices with two real eigenvalues 


Let us first consider the linear system of differential equations p = Ap 
where 


in F ‘le (20) 


(This system is very similar to the one considered in Example 1.) The 
matrix A is diagonal, so its eigenvalues are 2 and 3. The corresponding 
eigenvectors are [1 0]’ and [0 1)”, respectively. Following the method 
given in Unit 6, the general solution is constructed from these eigenvalues 
and eigenvectors, and is given by 


pal-<f eof 


where C and D are arbitrary constants. Equivalently, we have 
p(t) =Ce™, q(t) = De*. 


We are interested in the behaviour of phase paths near the equilibrium 
point at p = 0, q = 0. Consider, for example, the paths with D = 0 (and 
C #0). On these paths we have p(t) = Ce” and q(t) = 0, so the point 
(p(t), g(t)) moves away from the origin along the p-axis as t increases. 


On the other hand, consider the paths with C = 0 (and D #0). On these 
paths we have p(t) = 0 and q(t) = De**, so the point (p(t), q(t)) moves 
away from the origin along the q-axis as t increases. Hence we have seen 
that there are phase paths along the axes, corresponding to the 
eigenvectors [1 O]7 and [0 1)”. As t increases, a point on either of these 
axes moves away from the origin. 


Classifying equilibrium points 


The perturbations p and q can 
usually take negative, as well as 
positive, values. 


For a linear system of 
differential equations, the 
Jacobian matrix is the matrix of 
coefficients, and the equilibrium 
point is at p=0, q=0. 
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In this case, we can show that 
the paths are q = K|p|?/2, as in 
Example 1, but in this section 
we are interested in the 
qualitative behaviour. 


q 


Figure 13 A source 
(unstable) 
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For general values of C and D, where neither C = 0 nor D = 0, the point 
(Ce**, De®") still moves away from the origin as t increases, but not along a 
straight line. On the other hand, as t decreases, the exponential functions 
e** and e* decrease (and tend to zero as t tends to —oo). So the point 
(Ce*, De®") approaches the origin as t decreases, and all paths radiate 
from the origin. This is illustrated in Figure 13, where we have 
incorporated the fact that the only straight-line paths are the two axes, 
which correspond to the two eigenvectors of the matrix A. 


An equilibrium point with this type of qualitative behaviour in its 
neighbourhood is a source, and is unstable. This behaviour occurs for any 
linear system p = Ap where the Jacobian matrix A has positive distinct 
eigenvalues. The only straight-line paths are in the directions of the 
eigenvectors of the matrix A, although these will not, in general, be along 
the axes. 


Exercise 15 


Consider the linear system of differential equations 


P| _|3 9 |p 
aq} {2 IJ Lay” 
(a) Find the eigenvalues of the Jacobian matrix. 


(b) Classify the equilibrium point p = 0, gq = 0 of the system. 


Now consider the system of differential equations p = Ap where 
—2 0 
a-[2 4). a 
The change in sign for matrix A from equation (20) to equation (21) 
changes the solution from one involving positive exponentials to one 
involving negative exponentials. You can think of this as replacing t by —t, 
so the solutions describe the same paths, but traversed in opposite 


directions. This changes the direction of the arrows along the paths in 
Figure 13. 


So if the Jacobian matrix for a linear system has negative distinct 
eigenvalues, then the equilibrium point is a sink, and is stable. The only 
straight-line paths are along the directions of the eigenvectors of the 
Jacobian matrix. 


Exercise 16 

Consider the linear system of differential equations 
=> olf 
| {2 3] lal 

(a) Find the eigenvalues of the Jacobian matrix. 


(b) Classify the equilibrium point p = 0, gq = 0 of the system. 


3 


These conclusions are modified slightly when the two eigenvalues happen 
to be equal, as the following exercise illustrates. 


Exercise 17 


Consider the linear system of differential equations 


p| _ |2 O| |p 

q| [0 2] fa}’ 
which has eigenvalues 2 and 2, and eigenvectors [1 0]” and [0 1)”. 
(a) Find the general solution of the system of differential equations. 


(b) By eliminating t, find the equations of the paths, and describe them. 
(c) Is the equilibrium point p = 0, q = 0 stable or unstable? 


In Exercise 17, you saw that when the Jacobian matrix has two real 
identical positive eigenvalues (but there are still two linearly independent 
eigenvectors), all the paths are straight lines radiating away from the 
origin, as shown in Figure 14. The equilibrium point at p = 0, g = 0 is 
then called a star source (and is unstable). 


If there are two real identical negative eigenvalues (but there are still two 
linearly independent eigenvectors), then the arrows on the paths in 

Figure 14 are reversed, and the equilibrium point at p = 0, q = 0 is called a 
star sink, which is stable. This is illustrated in Figure 15. 


So far in this section we have considered the case where the Jacobian 
matrix has two positive eigenvalues and the case where the matrix has two 
negative eigenvalues. We now consider the case where the matrix has one 
positive eigenvalue and one negative eigenvalue. For example, consider the 
matrix 


1 4 
al) a) 
which has eigenvalues 2 and —3, and corresponding eigenvectors [4 1]" 


and {1 —1]". The general solution of the linear system of differential 
equations p = Ap is therefore 


fl-cf}eeoL de 


When D = 0 (and C # 0), we have p(t) = 4Ce”* and q(t) = Ce?*, and the 
point (p(t), q(t)) moves away from the origin along the straight-line path 
g= <P as t increases. On the other hand, when C = 0 (and D #0), the 
solution is p(t) = De~**, q(t) = —De~*, so the point (p(t), q(t)) 
approaches the origin along the straight-line path g = —p as t increases. 


(22) 


Hence we have seen that there are two straight-line paths. On the line 
q= +P (which corresponds to the eigenvector [4 1]”), the point moves 
away from the origin as t increases. However, on the line gq = —p (which 
corresponds to the eigenvector [1 —1]"), the point moves towards the 
origin as ¢ increases. 


Classifying equilibrium points 


We include here the case where 
both eigenvalues are equal, but 
we will always assume that there 
are two linearly independent 
eigenvectors. 


cs) 


Figure 14 A star source 
(unstable) 


q 


S 


Figure 15 A star sink 
(stable) 
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Figure 16 A saddle 
(unstable) 
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Now we will consider the behaviour of a general point (p(t), g(t)), where 
p(t) and q(t) are given by equation (22), and neither C nor D is zero. For 
large positive values of t, the terms involving e?’ dominate, so p(t) ~ 4Ce” 
and q(t) ~ Ce’. So for large positive values of t, the general path 
approaches the line gq = <P. On the other hand, for large negative values 
of t, the terms involving e~* dominate, so p(t) ~ De~*! and 

q(t) ~ —De~*". So for large negative values of t, the general path 
approaches the line g = —p. Using this information we can construct the 
paths in phase space, illustrated in Figure 16. 


An equilibrium point with this type of behaviour is called a saddle. It 
occurs when the Jacobian matrix has one positive eigenvalue and one 
negative eigenvalue. Again, the two straight-line paths are in the directions 
of the eigenvectors of the matrix. 


Exercise 18 


Consider the linear system of differential equations 


Pp} _|1 2) |p 
q| [2 —2} [a] ° 
(a) Find the eigenvalues and corresponding eigenvectors of the Jacobian 
matrix. 
(b) Classify the equilibrium point p = 0, q = 0. 
(c) Sketch the phase paths of the solutions of the differential equations. 


3.2 Matrices with complex eigenvalues 


In Unit 5 you saw that some matrices with real matrix elements have 
complex eigenvalues and eigenvectors. However, in Unit 6 you saw that 
these complex quantities can be used to construct the real solutions of the 
corresponding system of linear differential equations. Our next example 
involves such a system. 


Example 4 


Consider the linear system of differential equations 


p} _ |O —1| |p 
q| |4  O} lq’ 
(a) Find the eigenvalues and corresponding eigenvectors of the Jacobian 


matrix. 


(b) Hence obtain the general solution of the system of differential 
equations. 


(c) Show that the phase paths for these differential equations are the 
ellipses 


pt+a¢ =K, 
where K is a positive constant. 
Solution 
(a) The matrix has the characteristic equation 


-v -1 
| 4 =|” 


ie. \27+4=0. So the eigenvalues are \ = 2i and A = —2i. 


When \ = 2i, the eigenvector [a] satisfies the equation 


~2i -1] fa] _ fo 
4 —2i} |b] JO}? 
so —2ia — b = 0, which gives b = —2ia. Hence an eigenvector 
corresponding to the eigenvalue \ = 2i is [1 —2z]”. 
Similarly, an eigenvector corresponding to the eigenvalue \ = —2: is 
[1 2¢]*. 


The general solution of the system can be found by the method 
explained in Unit 6. This involves finding the real and imaginary parts 
of ve*', where and v are an eigenvalue—eigenvector pair. Using the 
eigenvalue 2i and the corresponding eigenvector [1 —2i]", we get 


ial pe | 7 
ca = fe (cos 2¢ + 7 sin 2t) 


cos 2t .| sin 2¢ 
- , sin 2 we i cos a ; 
The general solution can then be written down as 
fa] =©[2snae] + Seosae 
where C and D are arbitrary constants. 
We have 
p(t) = Ccos 2t + Dsin 2¢, 
q(t) = 2C sin 2t — 2D cos 2t, 
so 
p’ +49 = (Ccos2t + Dsin 2t)? + (Csin 2t — Dcos 2t)? 
= (C* cos” 2t + 2C'D cos 2t sin 2t + D? sin? 2t) 
+ (C? sin? 2t — 2C'D cos 2t sin 2t + D? cos? 2) 
= C? (cos? 2t + sin? 2t) + D*(cos? 2¢ + sin? 2t) 
=C 4D? =, 
where K = C? + D?. 


Classifying equilibrium points 


The standard equation for an 
ellipse is 
2 2 
x 
+5 
a b? 


where a and b are constants. 


=1 


? 


It does not matter which of the 

two eigenvalue—eigenvector pairs 
we choose, as they are complex 

conjugates of one another. 


See Procedure 2 and Example 5 
of Unit 6. 
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Sy 


Figure 17 A centre (stable) 
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So the phase paths are ellipses, as shown in Figure 17. The direction 
of the arrows can be deduced from the original differential equations. 
For example, in the first quadrant, p = —q < 0 and g=4p> 0. 


In Example 4, you saw that the phase paths are ellipses. This type of 
behaviour corresponds to any linear system of differential equations where 
the eigenvalues of the Jacobian matrix are purely imaginary. An 
equilibrium point that has this behaviour in its neighbourhood is called a 
centre, and is stable. More generally, if all the phase paths in the vicinity 
of an equilibrium point are closed curves, then the equilibrium point is 
stable and is called a centre. 


Exercise 19 

Consider the linear system of differential equations 
ib olf 
q 5 —2] |q|- 

(a) Find the eigenvalues of the Jacobian matrix. 


(b) Classify the equilibrium point p = 0, q = 0. 


In general, when the eigenvalues of a matrix are complex, they are not 
purely imaginary but also contain a real part. This has a significant effect 
on the solution of the corresponding system, as you will see in the 
following example. 


Example 5 
Find the general solution of the system of equations p = Ap, where 
—2 —3 
A= : | | 
Sketch some phase paths corresponding to the solutions of the system. 


Solution 


The characteristic equation of the Jacobian matrix is (2+ A)? + 9 = 0, so 
the eigenvalues are —2 + 3i and —2 — 32. The corresponding eigenvectors 
are [1 —i]? and [1 iJ”, respectively. To construct the general solution, 
we need to find the real and imaginary parts of [1 —i]” e(—2+3i)t| We get 


on 2t edit | | = e 4(cos 3t + isin 3t) 2 


—i 
a4 | cos 3t . 94 | sin dt 
—_ ba 3 +6 i cos | : 


3 Classifying equilibrium points 


So the general solution is 


P| — 7 —2¢ | cos 3t _o4 | sin 3t 
A Te Ce a vie E cos “| , 


where C' and D are arbitrary constants. 
If we neglect, for the time being, the e~! factors, the solution is 


p = Ccos3t + Dsin 3t, 
gq = Csin 3t — D cos 3t, qa 


from which it follows that 


pP+qQ=C?+D? 


Sy 


(the argument is similar to that given in the solution to Example 4). 


So, in the absence of the e~?’ terms, the paths would be circles centred on 
the origin. The effect of the e~?’ terms on these paths is to reduce the 
radius of the circles gradually. In other words, the paths spiral in towards Figure 18 A spiral sink 
the origin as ¢t increases, as shown in Figure 18. (stable) 


In Example 5 the paths spiral in towards the origin, so the origin is a sink 

(which is called a spiral sink) and therefore is a stable equilibrium point. qh 
If the paths spiralled away from the origin, we would have a spiral source 
(Figure 19) with the equilibrium point unstable. The stability is 
determined by the sign of the real part of the complex eigenvalues. If the 
real part is positive, then the general solution involves e*' terms (where k 
is positive) and the equilibrium point is an unstable spiral source; if the 
real part is negative, then the general solution involves e~** terms and the 
equilibrium point is a stable spiral sink. 


Sv 


Figure 19 A spiral source 
(unstable) 


Exercise 20 

Consider the linear system of differential equations 
HeLa dt 
q 1. A) ial ° 

(a) Find the eigenvalues of the Jacobian matrix. 


(b) Classify the equilibrium point p = 0, q = 0. 


3.3 Classifying equilibrium points of linear systems 


We now summarise the results of the previous three subsections. The 
phase diagrams are collected together in Figure 20. 
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Real eigenvalues, 
distinct 


Both positive: source 


Both negative: sink 


Differing signs: saddle 


Real eigenvalues, 
equal 


q 


Positive: star source 


q 


3 


Negative: star sink 


Complex 
eigenvalues 


qa 


Sv 


Positive real part: 
spiral source 


Sv 


Negative real part: 
spiral sink 


qA 


Sv 


Pure imaginary: 
centre 


Figure 20 Phase diagrams of linearised equations 


Procedure 3 Classification of the equilibrium points of a 
linear system 


Consider the linear system p = Ap, for a 2 x 2 matrix A. The nature 
of the equilibrium point at p = 0, q = 0 is determined by the 
eigenvalues and eigenvectors of A. 


1. If the eigenvalues are real and distinct, then: 


e if both eigenvalues are positive, the equilibrium point is a 
source (and is unstable) 


e if both eigenvalues are negative, the equilibrium point is a 
sink, (and is stable) 


e if one of the eigenvalues is positive and the other is negative, 
the equilibrium point is a saddle (and is unstable). 
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2. Ifthe eigenvalues are real and equal (and there are two linearly 
independent eigenvectors), then: 


e if the eigenvalues are positive, the equilibrium point is a star 
source (and is unstable) 


e if the eigenvalues are negative, the equilibrium point is a star 
sink (and is stable). 


3. If the eigenvalues are complex, then: 


e if the eigenvalues are purely imaginary, the equilibrium point 
is a centre (and is stable) 


e if the eigenvalues have a positive real part, the equilibrium 
point is a spiral source (and is unstable) 


e if the eigenvalues have a negative real part, the equilibrium 
point is a spiral sink (and is stable). 


Procedure 3 is not exhaustive; for example, it does not include a number of 
special cases, such as where one of the eigenvalues is zero. 


Exercise 21 


(a) Suppose that all you are told about a given equilibrium point is that 
both the eigenvalues of its Jacobian matrix are positive, or have a 
positive real part. What are the possible types of equilibrium point 
that fit this description? 


(b) Suppose that all you are told about a given equilibrium point is that 
both the eigenvalues of its Jacobian matrix are negative, or have a 
negative real part. What are the possible types of equilibrium point 
that fit this description? 


Exercise 22 


In Example 3 you saw that the Lotka—Volterra equations can be 
approximated by the system of linear differential equations 


pl _ 0 —kxX/Y| |p 
Hee 0 (k > 0 and h > 0) 
in the neighbourhood of the equilibrium point (X,Y). Find the eigenvalues 


of the Jacobian matrix, and hence classify the equilibrium point p = 0, 
q = 0 for the linearised system around (X,Y). 
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Exercise 23 


In Exercise 11 you saw that the Lotka—Volterra equations can be 
approximated by the system of linear differential equations 


F-6 =) 


in the neighbourhood of the equilibrium point (0,0). Find the eigenvalues 
of the Jacobian matrix, and hence classify the equilibrium point p = 0, 
q = 0 for the linearised system around (0,0). 


3.4 Classifying equilibrium points of non-linear 
systems 


In Section 2 you saw how to find the equilibrium points of non-linear 
systems of differential equations x = u(x), and how to find the linear 
system p = Ap that approximates the system in the neighbourhood of an 
equilibrium point. In this section you have seen how to classify an 
equilibrium point of the linear system by finding the eigenvalues and 
eigenvectors of the matrix A. But is the behaviour of the non-linear 
system near the equilibrium point the same as the behaviour of the linear 
system that approximates it? It can be shown that, not surprisingly, the 
answer is yes, except when the equilibrium point of the approximating 
linear system is a centre. 


Near a centre, the paths of the approximating linear system are circular or 
elliptical. However, the paths of the original non-linear system may spiral 
towards or away from the equilibrium point, or they may be closed curves. 
In such cases, we can say only that the paths are approximately circular or 
elliptical; we can say nothing about their actual behaviour without further 
examination. Thus, if the linear approximation has a centre, we cannot 
immediately deduce the nature of the equilibrium point of the original 
non-linear system: it may be a stable centre, a stable spiral sink or an 
unstable spiral source. 


Procedure 4 Classification of the equilibrium points of a 
non-linear system 


To classify the equilibrium points of the non-linear system of 
differential equations 


x = u(z,y), 


do the following. 


3 Classifying equilibrium points 


1. Find the equilibrium points by using Procedure 1. 


2. Use Procedure 2 to find the linear system 
p= Ap 


that approximates the original non-linear system in the 
neighbourhood of each equilibrium point. 


3. For each equilibrium point, use Procedure 3 to classify the linear 
system. 


The behaviour of the original non-linear system near an equilibrium 
point is the same as that of the linear approximation, except when 
the linear system has a centre. If the linear system has a centre, the 
equilibrium point of the original non-linear system may be a centre 
(stable), a spiral sink (stable) or a spiral source (unstable). 


In the case of the Lotka-Volterra equations (15), in Exercise 23 you have 

seen that the linear system of differential equations that approximates the 

non-linear system in the neighbourhood of the equilibrium point (0,0) has 

an (unstable) saddle at the equilibrium point. So the (non-linear) 

Lotka—Volterra equations also have an (unstable) saddle at the equilibrium 

point (0,0). y (iY) 


You also saw in Exercise 22 that the linear system of differential equations 
that approximates the Lotka—Volterra equations in the neighbourhood of 
the equilibrium point (X,Y) has a (stable) centre at the equilibrium point. 
This means that we cannot immediately say anything about the 
classification of this equilibrium point of the original (non-linear) system of 
differential equations — it could be a centre, a spiral sink or a spiral source. 
However, further investigation (using a method that will be introduced in 
Subsection 3.5) shows that with the exception of the equilibrium points 
and the coordinate axes, every phase path of the Lotka-Volterra equations 


is a closed path. (These closed paths are not ellipses, however.) So the x 
equilibrium point (X,Y) of the Lotka-Volterra equations is a (stable) Figure 21 Phase diagram 
centre, as shown in Figure 21. for the Lotka—Volterra 


ot . : , , equations, showing closed 
The following important example illustrates the steps involved in locating pins e paths and ss sentee at 


and classifying equilibrium points. (X,Y) 


Example 6 

Consider the non-linear system of differential equations 
x= —4y + 2ry — 8, 
y= Ay? — x. 

(a) Find the equilibrium points of the system. 


(b) Compute the Jacobian matrix of the system. 
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(c) In the neighbourhood of each equilibrium point: 
e —linearise the system of differential equations 
e classify the equilibrium point of the linearised system. 


(d) What can you say about the classification of the equilibrium points of 
the original (non-linear) system of differential equations? 


Solution 

(a) The equilibrium points are given by 
—4dy + 2xy —8 =0, 
Ay* — +? = 0. 


The second equation gives 


eS aly. 

When x = 2y, substitution into the first equation gives 
—4y + 4y7-8=0, 

or y? — y— 2 =0, which factorises to give 
(y—2)(y+1) =0. 

Hence 
y=2 or y=-l. 


When y = 2, x = 2y = 4. When y = —1, x = 2y = —2. So we have 
found two equilibrium points, namely (4,2) and (—2,—1). 


When x = —2y, substitution into the first equation gives 
—Ay — 4y? — 8 =0, 
or y? +y+2=0. This quadratic equation has no real solutions, so 
there are no more equilibrium points. 
(b) With the usual notation, 


v(x, y) = 4y? — 2”. 


So the Jacobian matrix is 


Ou Ou 
Ox Oy] | 2y 22x-4 
Ov Ov| |-2xr By 
Ox Oy 
(c) At the equilibrium point (4,2), the Jacobian matrix is 
4 A 
—8 16]° 


The characteristic equation of this Jacobian matrix is 


(4— )(16 — A) + 32 =0, 
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or A? — 20 + 96 = 0, which factorises to give 
(A — 8)(A — 12) = 0, 

so the eigenvalues are 
A=8 and A=12. 


The two eigenvalues are positive and distinct, so the equilibrium point 
p=0,q =0is a source, which is unstable. 


At the equilibrium point (—2,—1), the Jacobian matrix is 


Pio 

4 —8|° 

The characteristic equation of this Jacobian matrix is 
(—2 — A)(—8 — A) + 82 = 0, 

which simplifies to 
dN? + 10\ + 48 = 0. 

The roots of this quadratic equation are 

= = 5 4iv58, 


so the eigenvalues are complex with a negative real part. Hence the 
equilibrium point p = 0, g = 0 is a spiral sink, which is stable. 


— 


(d) As neither of the equilibrium points found in part (c) is a centre, the 
non-linear system has an equilibrium point (4,2) that is a source 
(unstable), and an equilibrium point (—2,—1) that is a spiral sink 
(stable). 


Exercise 24 


Find the eigenvalues and eigenvectors of the matrix 


2 -3 
a= al 
and hence find the general solution of the system p = Ap. Classify the 
equilibrium point p = 0, gq = 0. 


If this system is the linear approximation to a non-linear system 
x = u(z,y) in the neighbourhood of an equilibrium point, what can you 
say about this equilibrium point of the non-linear system? 
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Exercise 25 

Consider the non-linear system of differential equations 
£=(1+2-—-2y)z, 
y= (a— Vy. 

(a) Find the equilibrium points of the system. 

(b) Find the Jacobian matrix of the system. 

(c) In the neighbourhood of each equilibrium point: 


e find the linear system of differential equations that gives the 
approximate behaviour of the system near the equilibrium point 


e find the eigenvalues of the Jacobian matrix 


e use the eigenvalues to classify the equilibrium point of the 
linearised system. 


(d) What can you say about the classification of the equilibrium points of 
the original non-linear system of differential equations? 


3.5 Constants of motion 


You saw in Exercise 22 that the (non-linear) Lotka—Volterra equations can 
be linearised about the equilibrium point (X,Y), and that this point is a 
(stable) centre for the linearised system. However, this is not enough to 
show that (X,Y) is a stable equilibrium point of the original non-linear 
equations. In fact, (X,Y) is a stable centre of the Lotka—Volterra 
equations, as shown in Figure 21, but how can we establish this fact? 


The trick is to show that there is a constant of motion. This is a 
function K(2,y) that remains constant as we follow any given phase path. 
To see what this means, consider a function K (x,y) as x and y trace out a 
path in phase space. Then the rate of change of K (x,y) with respect to t 
is obtained by applying the chain rule of Unit 7. We have 
dk OK dx OK dy 
dt Ox dt Oy dt’ 
where dx/dt = « and dy/dt = y are the components of the velocity of the 
phase point in phase space: in this context, these are given by the 
Lotka—Volterra equations (15). The function K(x, y) is a constant of 
motion if dk /dt = 0, and this can be tested by checking that the 
right-hand side of equation (23) vanishes for all x and y. 


(23) 


If we can find a function K(z,y) that is a constant of motion for a given 
set of equations, it follows that AK remains constant as we trace out any 
given phase path. This means that the phase paths are coincident with the 
contour lines of K(x, y), which can be investigated quite easily. 


3 Classifying equilibrium points 


Even if a constant of motion exists for a given system of differential 
equations, finding the appropriate function K(x, y) is not easy and often 
requires informed guesswork. You will not be asked to do this, but you 
may be asked to verify that a given function is a constant of motion, using 
equation (23). 


In the case of the Lotka—Volterra equations, it turns out that there is a 
constant of motion, namely 


h k 
K(2,y) =hinat+kiny Sa ae (24) 


where h and k are positive constants. The contour lines of this scalar field 
are plotted in Figure 22; they are closed curves and have the same shape 
as the phase paths plotted earlier, in Figure 21. Depending on the initial 
conditions, the phase point orbits around a particular contour, so that the 
motion of the Lotka—Volterra model is always periodic in time. The period 
depends on which contour is followed. 


Example 7 
Show that 
h k; 
K(z,y)=hlnz+kIny x27 yy 


is a constant of motion for the Lotka—Volterra equations. 
Solution 


The partial derivatives are 
OK hk h_ h(X—-z) 


Ox ax X xX ” 
OK kk k _ kY—y) 
Oy y Y yw ~ 
From the Lotka—Volterra equations (15), the velocity components are 
ea Reh) og 4p - DX = 2) 
= Y a — X : 
The rate of change of K is therefore 
dk hk 
= ael(X-a)¥ - 9) - - W(X -2)] =0 


A more general understanding of phase paths 


We have addressed behaviour in the immediate vicinity of an 
equilibrium point. But what happens more generally? 


If there is a constant of motion, then the path follows its contours: 
these could be closed curves (as for the Lotka—Volterra equations), or 
they could be open curves, which run off to infinity. 


(X,Y) 


ay 
Figure 22 Contour lines of 
the scalar field K(z, y) for 


the Lotka—Volterra equations 
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Figure 24 Henri Poincaré 
(1854-1912) and his 
flamboyant signature. He 
pioneered the geometric 
analysis of systems of 
differential equations, along 
with important contributions 
to many other topics in 
mathematics, physics and 
engineering. 
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But having a constant of motion is a special case; for ‘most’ choices of 
the functions u(x, y) and v(x, y) in equations (1), there is no constant 
of motion. In order to appreciate what can happen in the general 
case, we need to describe a behaviour that we have not yet 
encountered. This is where paths converge towards a single closed 
curve, which is called a limit cycle. 


Figure 23 illustrates the distinction between the spiralling paths 
around a limit cycle (part (a)) and the closed paths that arise when 
there is a constant of motion (part (b)). Around a limit cycle, paths 
corresponding to different initial conditions all approach the same 
closed curve (the limit cycle) as t > oo. When there is a constant of 
motion with closed contour lines, we have a set of distinct closed 
paths, each characterised by different initial conditions. 


Yr Yt 


Sy 
Sy 


(a) (b) 


Figure 23 Contrasting phase paths around (a) a limit cycle 
(in blue) and (b) a centre 


So what happens in the typical case, where there is no constant of 
motion? The first systematic study was made in the 1880s by Henri 
Poincaré (Figure 24), who showed that most two-dimensional, 
autonomous systems have paths that do one of three things: 


e approach a stable equilibrium point 
e approach a limit cycle 
e run off to infinity. 


The chaotic behaviour illustrated in Figure 1 is not consistent with 
the path approaching a limit cycle. Poincaré appreciated that chaotic 
motion could exist, but that it requires at least three coupled 
equations (in the case of autonomous systems). 


4 Motion of a rigid pendulum 


4 Motion of a rigid pendulum 


In the Introduction we mentioned that non-linear differential equations 
arise in the description of mechanical systems. We will present a brief 
discussion of just one mechanical system, taking its equation of motion as 
given. This is included because it illustrates a useful general principle: 
higher-order differential equations are often written as systems of 
first-order equations in a larger number of variables. There are various 
advantages in this approach. Here we emphasise that it leads to a 
graphical representation of the motion in phase space. This helps us to 
give qualitative descriptions of differential equations that we cannot solve 
exactly. 


4.1 Equations of motion for a rigid pendulum 


We consider the motion of a rigid pendulum, illustrated in Figure 25. 
There is a mass m at the end of a rigid rod, which moves freely in a fixed 
vertical plane. Let 6 (measured in radians) be the angular displacement 
from the downward vertical in an anticlockwise direction. When frictional 
forces can be neglected, the equation of motion for 6 as a function of time t 
is the rigid pendulum equation or undamped pendulum equation 


6 =—w* sind, (25) 


where w is a positive constant. You can think of this as a form of Newton’s 
second law where the force is proportional to sin, but a satisfactory 
derivation requires a relatively sophisticated approach. Note that the force 
is zero when 6 = 7, as well as when @ = 0. This is a consequence of the fact 
that the rigid pendulum can, in principle, be balanced so that the mass is 
vertically above the pivot. 


We also mention two closely-related equations. 


If the displacement of the pendulum is small, you can use the 
approximation sin @ ~ @, and the equation of motion (25) is replaced by an 
equation that we refer to as the simple pendulum equation 


6 = —w"6. (26) 


This equation has the advantage that it is linear, but the disadvantage 

that it is a good approximation only for small oscillations. Of course, it is 

the same as the equation for simple harmonic motion, which was discussed 

in Unit 3. 

We also consider the damped pendulum equation 
6 = —w* sin 6 — €6, (27) 


where € is a positive constant. This equation is very similar to the 
equation for the damped harmonic oscillator, also considered in Unit 3: 
the term proportional to @ = d@/dt represents the effect of a frictional force 
that resists the movement of the rod. 


The derivation of equations of 
motion often requires special 
techniques, such as those of 
Lagrangian mechanics, and is 
beyond the scope of this module. 


are 


A rigid pendulum 


Figure 25 
consisting of a mass 
(sometimes called a bob) at 
the end of a pivoted rigid rod 
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4.2 The phase plane for a pendulum 


In the Introduction we mentioned that the second-order differential 
equation (25) can be written as two first-order equations. Here we return 
to look at this point in greater depth. 


Although the differential equations (25), (26) and (27) in the previous 
subsection are of second order, we can rewrite each of them as a pair of 
first-order differential equations; this will enable us to use the techniques 
from earlier in the unit. More precisely, we will replace @ by x and @ by y, 
so that 


and 
y=t=8. 


So, for example, equation (25) can be rewritten as the system of first-order 
differential equations 


L=Y, 
y = —w’ sina, 
which can be rewritten in terms of a vector field as 
x =u(2,y), (28) 
where 
= Yy 
u(z,y) = |p (sal , 


Let us consider the significance of equation (28). Starting from (25), which 
is a second-order differential equation in a single variable 0, we 
transformed this into (28), which is a first-order differential equation 
describing the motion of a point in a two-dimensional phase space, where 
the coordinates are the angle x = @ and its rate of change y = 0. 


Exercise 26 


Using the technique employed above, rewrite equation (27) as a system of 
first-order differential equations. 


So the two models introduced in Subsection 4.1 for the motion of a 
pendulum when the oscillations can be large give rise to two pairs of 
first-order differential equations. 


The pendulum equations 
e = For arbitrarily large oscillations and no friction, we have 
k=y, y= -w’sing, (29) 


arising from the undamped pendulum equation. 


4 Motion of a rigid pendulum 


e = For arbitrarily large oscillations and a frictional force, we have 


2B 


L=y, y= —w' sing —ey, (30) 


arising from the damped pendulum equation. 


The analogy with our previous discussion of two interacting populations 
should be immediately obvious, but here the variables 7 and y are even 
more closely related than before, since one is the derivative of the other. 
A phase point representing a solution of equations (29) or (30) at a given 
time would tell us not only the position of the pendulum bob, but also its 
velocity. 


For a pendulum, the variable x = 6 represents an angle measured in 
radians, so the points (a + 27, y) and (x,y) represent the same state of the 
system. We could restrict the range of x to —m < x < 7, although we could 
use any interval of length 27, such as 0 < x < 27, for example. 


Although we can solve the simple pendulum equation (26), we cannot find 
simple analytical solutions of the undamped and damped pendulum 
equations (25) and (27). However, we can use the techniques developed in 
Sections 1-3 of this unit to investigate the qualitative behaviour of the 
solutions of these equations. 


Exercise 27 
(a) Find the equilibrium points of the system described by equations (29), 
i.e. 
r= y, 


yaw 


sing (-at<a2<7), 
which is the system of differential equations arising from the 


undamped pendulum equation. 


(b) Describe physically the two equilibrium points that you found in 
part (a). On physical grounds, would you expect these equilibrium 
points to be stable or unstable? 


Exercise 28 
(a) Find the equilibrium points of the system described by equations (30), 
i.e. 
r= Y, 
ne De 
y= —w'sinx—ey (-t<a<n), 
which is the system of differential equations arising from the damped 
pendulum equation. 


(b) Describe physically the two equilibrium points that you found in 
part (a). On physical grounds, would you expect these equilibrium 
points to be stable or unstable? 
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In Exercise 27, you showed that the undamped pendulum has two 
equilibrium points. The first equilibrium point is the origin x = 0, y = 0, 
which corresponds to the pendulum hanging vertically downwards at rest, 
and physically we expect this to be stable. The second equilibrium point is 
x=, y = 0, which corresponds to a stationary pendulum pointing 
vertically upwards, which we would not expect to be stable. To classify 
these equilibrium points mathematically we must first consider the 
corresponding linearised equations. 


Exercise 29 
Consider the non-linear system of differential equations 
t=y, 
ee ae 
y = —w* sina, 
which is the system of differential equations arising from the undamped 
pendulum equation. 
(a) Find the Jacobian matrix of the system. 
(b) In the neighbourhood of each of the equilibrium points (0,0) and (7, 0): 


e find the linear system of differential equations that gives the 
approximate behaviour of the non-linear system near the 
equilibrium point 


e find the eigenvalues of the Jacobian matrix 


e use the eigenvalues to classify the equilibrium point of the 
linearised system. 


We have seen that an undamped rigid pendulum has two equilibrium 
points, at « = 7, y = 0 (corresponding to a stationary pendulum pointing 
vertically upwards) and at x = 0, y = 0 (corresponding to a stationary 
pendulum hanging vertically downwards. In the approximation of 
linearised equations, the point at x = 7, y = 0 is a saddle (which is 
unstable) and the point at x = 0, y = 0 is a centre (which is stable). 


For the non-linear rigid pendulum equations, we can again conclude that 
the equilibrium point at x = 7, y = 0 is a saddle (which is unstable). 
However, the equilibrium point at « = 0, y = 0 may be either a centre 
(stable), or a spiral sink (stable) or a spiral source (unstable). This 
uncertainty can be resolved by noting that the non-linear rigid pendulum 
equations have a constant of motion. An argument similar to that given in 
Subsection 3.5 can then be used to show that the « = 0, y = 0 equilibrium 
point is a centre and is therefore stable. This makes good sense physically: 
the pendulum undergoes periodic motion as it swings to and fro. 


Exercise 30 


Use the equations of motion for an undamped pendulum, equations (29), 
to show that 


4 Motion of a rigid pendulum 


E24) = sy + w*(1 — cos x) 


is a constant of motion for the undamped pendulum. (If you have studied 
mechanics, you may recognise that this is proportional to the sum of the 
kinetic energy and the gravitational potential energy.) 


So far we have investigated the motion of the pendulum in the 
neighbourhood of the equilibrium points. But what about the motions 
that are not close to the equilibrium points? We can investigate these by 
considering the vector field, which is shown in Figure 26 along with the 
associated phase paths. Two of the paths shown represent the pendulum 
continuously circling the support in the same direction, with the value of 
x (= @) always increasing or decreasing, so that the bob passes repeatedly 
through the vertical. The path EF'GH describes an anticlockwise rotation 
of the bob, and I.J KL describes a clockwise rotation. These paths do not 
look closed on the diagram, but they really are because points for which x 
differs by 27 are equivalent. 


Figure 26 Phase diagram for a rigid pendulum; points for which x differs 
by 27 are equivalent 


Figure 26 also shows a path that is a closed curve ABCD: this 
corresponds to a swinging motion of the pendulum, where there is a 
maximum angle of deflection and where the sign of the angular velocity 
can be positive or negative. Finally, the figure also shows a special phase 
curve where the pendulum reaches x = 7 and x = 3a with zero angular 
velocity (y = 6 = 0). This curve, which divides the rotational and 
vibrational motions, is called the separatriz. 


In the following exercises, we investigate the behaviour of the damped 
pendulum. 
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Exercise 31 
Consider the non-linear system of differential equations 
t=y, 
y= —w* sina — EY, 
arising from the damped pendulum equation. 
(a) Find the Jacobian matrix of the system. 
(b) In the neighbourhood of each of the equilibrium points (0,0) and (7,0): 


e find the linear system of differential equations that gives the 
approximate behaviour of the non-linear system near the 
equilibrium point 

e find the eigenvalues of the Jacobian matrix 


e use the eigenvalues to classify the equilibrium point of the 
linearised system. 


Note: For the equilibrium point (0,0), you will need to treat the cases 
0 <e< 2w and € > 2w separately. You may ignore the possibility 
E = 2Qw. 


Exercise 32 


The figure below shows the vector field for equations (30), which arise from 
the damped pendulum equation for 0 < ¢ < 2w. Describe the behaviour of 
the pendulum as it follows the path ABCD. 


Phase diagram for a damped pendulum; the phase paths spiral towards 
the equilibrium point (6,0) = (0,0), where the bob hangs downwards 


4 Motion of a rigid pendulum 


An overview of non-linear differential equations 


Non-linear differential equations can describe a vast range of 
phenomena, and you will find a bewildering number of techniques for 
treating them discussed in textbooks. But there are three basic 
approaches that a mathematically trained scientist tries when 
confronted with non-linear differential equations. These are: 


e Consider the equilibrium points of the equations and their 
stability. 

e ‘Try to use geometrical insights, perhaps by making a sketch of 
the phase paths. 


e Use a computer to calculate solutions using numerical methods. 


The first two of these approaches have been discussed at length in this 
unit. Let us make a few comments about how computers are used to 
solve non-linear equations. The usual tactic is to reduce the problem 
to a system of first-order differential equations, using the approach 
discussed in this section. In Unit 2 we explained how first-order 
differential equations may be solved by using Euler’s method, 
programming a computer to do the repetitive tasks. Euler’s method 
(and the more sophisticated variants that are used in practice) is 
easily extended to deal with systems of coupled first-order equations. 


Of course, there are many approaches tailored to work with particular 
types of differential equation. But the three approaches mentioned 
above are the powerful general-purpose tools. 


Postscript: what is chaos? 


In the Introduction we mentioned that systems described by non-linear 
differential equations can show a property called ‘chaos’, which is present 
in the trajectory shown in Figure 1. We are now able to give a clearer 
description of what this term means. 


In Sections 2 and 3 we discussed the stability of equilibrium points. This 
idea can be extended to consider the stability of trajectories. Consider a 
trajectory of a system of equations, represented by a vector 

r(t) = (x(t), y(t), z(t)). Compare this with a nearby trajectory r(t) + dr(t), 
where dr is very small when t = 0. We can ask how the separation 

s(t) = d|r(t)| of two nearby trajectories grows as a function of time t. 


It turns out that there are systems where the separation s(t) of trajectories 
grows like an exponential function of time: s(t) ~ Sexp(At), for some 
positive constants S and \. A system is said to be chaotic if it has this 
property of ‘exponential instability’. 
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Chaos is commonly found in systems that have more than two variables, 
such as the very complicated equations that determine the weather. In 
1961 one of the pioneers of this field, Edward Lorenz (1917-2008), was 
using a computer to model a weather prediction. When, as a shortcut, he 
entered some data as 0.506 instead of the more precise 0.506 127, he found 
that the program gave an entirely different prediction. A tiny shift of the 
starting point of a trajectory had grown into a large separation. He made 
a very elegant statement of the significance of this discovery: one of his 
conference presentations (in 1972) was given the title ‘Predictability: does 
the flap of a butterfly’s wings in Brazil set off a tornado in Texas?’. 


The early papers on chaos theory from the 1960s do not assume much 
more mathematical knowledge than you have gained from studying this 
module. And more generally, if you continue to study quantitative 
sciences, you will find that the topics treated in this module can take you a 
long way. We hope that you will find some of the material useful, wherever 
your curiosity takes you in the future. 


Learning outcomes 


After studying this unit, you should be able to do the following. 


e Use a vector field to describe a pair of first-order non-linear differential 
equations, and use phase paths to represent the solutions. 


e Understand the Lotka—Volterra equations modelling the populations of 
predators and prey, and interpret their solution using phase paths. 

e Interpret points and paths in the phase plane. 

e Determine whether an equilibrium point is stable or unstable by 
sketching paths near it. 

e Find the equilibrium points for a system of non-linear differential 
equations. 

e Find linear equations that approximate the behaviour of a system of 
non-linear differential equations near an equilibrium point. 


e Use the eigenvalues and eigenvectors of the Jacobian matrix to classify 
an equilibrium point for a system of linearised equations. Where 
possible, use this information to classify equilibrium points of the 
corresponding non-linear equations. 


e Describe, using vector fields and phase paths, the qualitative 
behaviour of the undamped pendulum and the damped pendulum. 


e Check that a given quantity is a constant of motion. 


Solutions to exercises 


Solution to Exercise 1 


The growth rate is proportional to the current population when every 
individual has an equal opportunity to survive and reproduce, and there 
are no external factors, such as a shortage of food, that might limit 
growth. This is generally true when the population is relatively small 
(although when the population is very small, its growth could be limited 
by difficulties in finding a mate). 


Solution to Exercise 2 


Assuming a positive constant proportionate growth rate means that no 
matter how large the population becomes, the proportionate birth rate 
exceeds the proportionate death rate by the same amount. The population 
goes on increasing exponentially. This can never be completely realistic for 
animals in the wild: for example, at some point the food supply that 
sustains the population must begin to be exhausted. The difference 
between the proportionate birth and death rates must then fall. 


Solution to Exercise 3 


The solution of the differential equation y = —hy is y = yoe~/™, where yo 
represents the initial fox population at t = 0. So the number of foxes is 
declining exponentially (because h > 0). This decrease is what we would 
expect as the foxes have no access to their assumed sole source of food, 
namely rabbits. 


Solution to Exercise 4 
The system of differential equations is 


The general solution is 


a(t) =aoe’, y(t) =yoe ’, 


where 2p and yo are arbitrary constants. Eliminating t gives xy = A, so 
Yr; 
x 
for some constant A. Curves of this form are called hyperbolas. 


Some paths corresponding to these hyperbolas are shown in the figure in 
the margin. 


Paths with xr) = 0 and yo 4 0 approach the origin as t > oo, but strictly 
speaking they never reach it. The only path that includes the origin is the 
one with x9 = yo = 0, which starts at the origin and does not move away 
from it. 
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Solution to Exercise 5 


Rearranging equation (13), we obtain 

k; 

yu 

which is the equation of a straight line, as shown below. 


a 


0) 


0 Y 7 


The proportionate growth rate «/x of rabbits decreases as the population 
y of foxes increases, becoming zero when y = Y. The population x of 
rabbits will increase if the population y of foxes is less than Y, but it will 
decrease ify > Y. 


Similarly, rearranging equation (14), we obtain 


y ha 

-=-h+—. 

y aaa 
This is also the equation of a straight line, as shown below. 
y/y 

0 s 4 
—h 


The proportionate growth rate y/y of foxes increases linearly as the 
population x of rabbits increases. The fox population y will decrease if the 
population x of rabbits is less than X, but it will increase if z > X. 


Solution to Exercise 6 


(a) [0 Oj” (Note that u(0,0) = 0.) 

(b) [0 —10]7 

(c) [0 —5]7 

(d) [50 oj? 

(ce) [0 O]7 (Note that u(1000, 100) = 0.) 


Solutions to exercises 


(f) [0 5]* 

(g) [25 oj” 

(h) [-25 oj? 
Solution to Exercise 7 


(a) (i) The differential equations under consideration are 


Yy . 
= 0.05 (1 - — a ie (1 
. . 100)’ 4 y 
with « > 0 and y> 0. 


00) 
10007 ’ 


In this case, ¢ = 0 when x = 0 or when y = 100. 


ii) &£>0Owhenz >Oand0<y< 100. We ignore solutions with x < 0 
or y < 0 because populations 


iii) & <0 when x > 0 and y > 100. cannot be negative. 


( 
( 
(b) (i) y=0 when x = 1000 or when y = 0. 
(ii) y > 0 when x > 1000 and y > 0. 
(iii) y <0 when 0 < x < 1000 and y > 0. 


(c) Using the results above together with Figures 9 and 10, typical paths 
representing solutions are shown below. 


y 


1000 ’ 


This figure shows a path down the positive y-axis, a path to the right 
along the positive z-axis, and various cycles about the point 

(1000, 100). The path down the y-axis describes a population of foxes 
decreasing to zero in the absence of rabbits. The path to the right 
along the x-axis describes a population of rabbits increasing without 
limit in the absence of foxes. It will be shown later (in Subsection 3.5) 
that the cycles are closed (as shown in the diagram), rather than 
spirals. 


Solution to Exercise 8 
Using Procedure 1, we have to solve the pair of simultaneous equations 


O.la — 0.005ry = 0, 
—0.2y + 0.0004zy = 0. 
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Factorising these equations gives 
0.1a(1 — 0.05y) = 0, 
—0.2y(1 — 0.0022) = 0. 
From the first equation, either x = 0 or y = 20. 


If c = 0, the second equation gives y = 0, hence (0,0) is an equilibrium 
point. If y = 20, the second equation gives x = 500, so (500, 20) is another 
equilibrium point. 


Therefore the only equilibrium points are when there are no animals or 
when there is a balance between 500 prey and 20 predators. Using the 
values for this second equilibrium point, the equations can be put in the 
standard Lotka—Volterra form 


=0.1 (i-=), 59 (a-=). 
Coen Bye I" 500 


Solution to Exercise 9 

Procedure 1 leads to the pair of simultaneous equations 
«(20 —y) =0, 
y(10 — y)(10 — x) = 0. 

From the first equation, either x = 0 or y = 20. 


If « = 0, the second equation gives y = 0 or y = 10. If y = 20, the second 
equation gives x = 10. 


Hence the equilibrium points are (0,0), (0,10) and (10, 20). 


Solution to Exercise 10 
(a) Stable. (b) Unstable. (c) Unstable. 


Solution to Exercise 11 


We evaluate the various partial derivatives given in the solution to 
Example 3. At the equilibrium point (0,0), we obtain 


Ou Ou 
By (09) = ks a> ; 
Ov Ov 


Thus the required linear approximation is 
p\ __|k 0} |p 
q| {0 —h} [a]? 

giving the pair of equations 


p=kp, q=—hg. 


(These are the equations studied in Subsection 1.3.) 


Solution to Exercise 12 
Here we have 
u(x,y) = x(20 — y), 


giving partial derivatives 


Ou Ou 

ge pe 

Ov Ov 

Ae yi 10 —y), By (10—9)10—2) = 910 


So the Jacobian matrix of the vector field u(z, y) is 


20 — =x 
J(x,y) = Be i) 2(5 — y)(10 — x) |’ 


At the equilibrium point (10,20), we have 


0 7 | 


J(10, 20) = Be a 


so the linear approximation is 
p)..| 2 10] |p 
q|  |200 O q\’ 
giving the pair of equations 


p=—10g, G = 200p. 


Solution to Exercise 13 
Solving the equations 
3x2 + 2y—8=0, 
z+4y—6=0, 
we obtain the equilibrium point x, = 2, ye = 1. 


The Jacobian matrix is 


Ou Ou 
eo te 
Ov Ov} jl 4t- 
dx Oy 


xr) = 2(5 — y)(10 — 2). 


In this case, the elements of the Jacobian matrix are all constants, so 
putting x =2+pand y=1+4q, we obtain the matrix equation 


p| _ |3 2] |p 
gq} |1 4 lql- 
The corresponding system of equations is 


p= 3p + 2q, 
g=p+4q. 
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To find the equilibrium points, we solve the simultaneous equations 


0.52 — 0.000 052? = 0, 
—0.1ly + 0.0004ary — 0.01y? = 0. 


Factorising these equations gives 


0.52(1 — 0.00012) = 0, 
—0.1y(1 — 0.0042 + 0.1y) = 0. 


The first equation gives 
x=0 or x =10000. 

If x = 0, the second equation is 
—0.ly(1+0.1y) = 0, 


which gives y = 0 or y = —10. As y > 0, only the first solution is 
possible. This leads to the equilibrium point (0,0). 


If x = 10000, the second equation is 
—0.1y(—39 + 0.1ly) = 0, 


which gives y = 0 or y = 390. So we have found two more equilibrium 
points, namely (10000,0) and (10000, 390). 


We have 


u(a, y) = 0.52 — 0.000 052”, 
v(x, y) = —0.1y + 0.00042y — 0.01y?. 


So the Jacobian matrix is 


eS 0.5 — 0.0001” 0 
Y=! 9.0004y 0.1 +.0.0004x — 0.02y] ° 
At the equilibrium point (0,0), 


J(0,0) = ik 4] 


and the linearised approximations to the differential equations in the 
neighbourhood of this equilibrium point are 


p) [0.5 0 ] Ip 
q| | 0 —O.1) |q}~ 
At the equilibrium point (10000, 0), 


—0.5 0 | 


3(10000,0) = | are 


and the linearised approximations to the differential equations near 
this equilibrium point are 


Heer lk 


Finally, at the equilibrium point (10000, 390), 


J(10 000, 390) = fe = 5 


and the linearised approximations to the differential equations near 
the equilibrium point are 


llores a0 Ei 


Solution to Exercise 15 
(a) The characteristic equation of the Jacobian matrix is 
(3 — A)(1 — A) = 9, 
so the eigenvalues are \ = 3 and A= 1. 
(b) As the eigenvalues are positive and distinct, the equilibrium point is a 
source, and is unstable. 
Solution to Exercise 16 
(a) The characteristic equation of the Jacobian matrix is 
=Ke8 9) 9 =i, 
ie. 7 + 3A +2 =0, which factorises to give 
(A +1)(A+2) =0, 
so the eigenvalues are \ = —1 and A = —2. 
(b) As the eigenvalues are negative and distinct, the equilibrium point is a 
sink (which is stable). 
Solution to Exercise 17 
(a) The differential equations are 
p= 2p, 
q= 24, 
which have general solution 
p(t) =Ce*, q(t) = De”, 
where C and D are arbitrary constants. 


(b) Eliminating ¢ from the general solution, the equations of the paths are 


D 
=—xp=K 
q ao P, 


where kK = D/C is also an arbitrary constant. So the paths are all 
straight lines passing through the origin. 


The above analysis has neglected the possibility C = 0. In this case 
the path is p = 0, which is also a straight line passing through the 
origin, namely the q-axis. 


(c) The magnitudes of both p(t) and q(t) are increasing functions of time, 
so the point (p(t), q(t)) moves away from the origin as t increases. So 
the equilibrium point is unstable. 
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Solution to Exercise 18 


(a) 


The characteristic equation of the matrix is 
(1 — A)(—2 — A) —4=0, 

ie. A? + \— 6 =0, which factorises to give 
(A — 2)(A + 3) =0, 


so the eigenvalues are \ = 2 and A = —3. 


The eigenvector [a |’ corresponding to \ = 2 satisfies the equation 


b> 2] el=[d 


so —a+ 2b = 0, and an eigenvector corresponding to the positive 
eigenvalue \ = 2 is [2 1]?. Other eigenvectors corresponding to \ = 2 
are multiples of this; all these eigenvectors are along the line q = Sp. 


The eigenvector [a 6)" corresponding to A = —3 satisfies the equation 


Pp all=(d: 


so 4a + 2b = 0, and an eigenvector corresponding to the negative 


eigenvalue \ = —3 is [1 —2]”; all these eigenvectors are along the line 
q = —2p. 
The matrix has one positive and one negative eigenvalue, so the 


(unstable) equilibrium point is a saddle. 


There are two straight-line paths, namely g = 4p and q = —2p, 
corresponding to the two eigenvectors. On the line g = SD, the point 
(p(t), q(t)) moves away from the origin as t increases, because the 
corresponding eigenvalue is positive. On the line q = —2p, the point 
approaches the origin as t increases, because the corresponding 
eigenvalue is negative. This information, together with the knowledge 
that the equilibrium point is a saddle, allows us to sketch the phase 
diagram in the margin. 


Solution to Exercise 19 


(a) 


(b) 


The characteristic equation of the Jacobian matrix is 
(2 — A)(—-2 — A) +5 =), 
ie. \7 + 1=0, so the eigenvalues are \ =i and A = —i. 


As both of the eigenvalues are imaginary, the equilibrium point is a 
centre, which is stable. 


Solution to Exercise 20 


(a) 


The characteristic equation of the Jacobian matrix is 
(1—A)?+1=0, 
ie. A? — 24 +2 =0, which has complex roots \ = 1+iand A=1—-i. 


(b) As the eigenvalues are complex with positive real part, the equilibrium 
point is a spiral source (and is unstable). 
Solution to Exercise 21 


(a) The point could be a source, a star source or a spiral source (all of 
which are unstable). 


(b) The point could be a sink, a star sink or a spiral sink (all of which are 
stable) 
Solution to Exercise 22 


The Jacobian matrix is 
j= 0 —kX/ "| 


hyY/X 0 
which has the characteristic equation 
M+ hk =0. 
The eigenvalues are \ = +iVhk, which are purely imaginary, so the 


equilibrium point is a centre, which is stable. 


Solution to Exercise 23 


The eigenvalues of the Jacobian matrix are \ = k and 4 = —h, which are 
real and have opposite signs because k > 0 and h > 0. So the equilibrium 
point is a saddle. (In fact, in this case we have to restrict p and q to 
non-negative values, but this does not affect our conclusion.) 
Solution to Exercise 24 
The characteristic equation is (2 — r)(2 — A) + 9 = 0, which gives 

NW — 44+ 13 = 0. 
The eigenvalues are 
44+ V16—52 | 
= = 
The eigenvector [a |” corresponding to the eigenvalue 2 + 3% satisfies 


fs al [= [: 


so —3ia — 3b = 0. Hence an eigenvector corresponding to 2 + 32 is 
[1 —i]?. (Ina similar way, an eigenvector corresponding to 2 — 3i is 
[1 J*.) 


To find the general solution of the system of differential equations, we 
need to find the real and imaginary parts of {1 —i]7e@?+9+, We get 


ort pit = e* (cos 3t + isin 3t) 2 


i 
— pnt bes | yet | sin 3t | . 


r 2+ 32. 


sin 3t — cos 3t 
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The general solution is 


P| _ 24 | COS 3t ot sin 3t 
| ae is | Tae ; cos i 


As the eigenvalues are complex with a positive real component, the 
equilibrium point p = 0, q = 0 is a spiral source, which is unstable (see 
Figure 19). 


As the equilibrium point of the linear approximation is not a centre, the 
corresponding equilibrium point of the non-linear system is also a spiral 
source. 


Solution to Exercise 25 


(a) 


The equilibrium points are given by 
(l+a-—2y)r =0, 
(x —1)y=0. 
The second equation gives 
x=1 or y=0. 
When x = 1, substituting into the first equation gives 
2—2y=0, 
which leads to y = 1. So (1,1) is an equilibrium point. 
When y = 0, substituting into the first equation gives 
(l+z)z =0, 
hence « = 0 or = —1. So we have found two further equilibrium 
points, namely (0,0) and (—1,0). 
With the usual notation, 
u(z,y) = (lt+a—2y)e¢=24+2 -22y, 
v(2,y) = (@— ly = ay — y. 


So the Jacobian matrix is 


Ou Ou 
Ox Oy ae Med —2Q9 
Ov Ov| | y x—1]" 
dx Oy 


At the point (0,0), the Jacobian matrix is 


fs =) 


so the linearised system is 


F-( JE: 


The eigenvalues of the Jacobian matrix are \ = 1 and \ = —1. As one 
of the eigenvalues is positive and the other is negative, the equilibrium 
point of the linearised system is a saddle. 


At the point (—1,0), the Jacobian matrix is 


Po a: 


so the linearised system is 


F-[o JE) 


The characteristic equation of the Jacobian matrix is 

(—1 — A)(—2 — A) = 0, so the eigenvalues are \ = —1 and A = —2. As 
these eigenvalues are negative and distinct, the equilibrium point of 
the linearised system is a sink. 


At the point (1,1), the Jacobian matrix is 
| 
1 O}’ 
so the linearised system is 
db df 
q 1 0} [a] - 
The characteristic equation of the Jacobian matrix is 
(lotta s aA 22S0; 
The roots of this quadratic equation are 
\= 41 +iv7), 


so the eigenvalues are complex with a positive real part. 


Hence the equilibrium point of the linearised system is a spiral source. 


As none of the equilibrium points of the linearised systems found in 
part (c) are centres, the behaviour of the original non-linear system 
near the equilibrium points is the same as that of the linear 
approximations. In other words, 

(0,0) is a saddle, which is unstable, 

(—1,0) isa sink, which is stable, 

(1,1) — isa spiral source, which is unstable. 


Solution to Exercise 26 


If we replace @ by x and let y = & = 0, then we have 


y=%=0 = —w* sind — 60 = —w* sine — ey. 


So the system of first-order differential equations that is equivalent to 
equation (27) is 


tT—Y; 
y = —w* sine — ey. 


The associated vector field is 


u 


_ Y 
(2,9) = 2 sin x — “y 
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Solution to Exercise 27 


(a) 


To find the equilibrium points, we use Procedure 1 and put 
u(x, y) = 0. This gives 


y=0, 
—w’ sing = 0. 


So there are two equilibrium points in the range —7 < x < 7, namely 
(0,0) and (7,0). 


The equilibrium point (0,0) corresponds to x = 0, = 0. Physically, 
this corresponds to a stationary pendulum hanging vertically 
downwards. From experience, we know that a small disturbance from 
this equilibrium point will result in small oscillations about the 
downwards vertical. So we would expect this equilibrium point to be 
stable. 


The equilibrium point (7,0) corresponds to x = 7, & = 0, which is a 
pendulum pointing vertically upwards at rest. (Not easy to achieve in 
practice!) A small disturbance from this equilibrium point will result 
in the pendulum moving away from the upwards vertical and speeding 
up until it is vertically downwards. It will then move through its 
lowest position and continue to move in the same direction, slowing 
down and heading towards the highest point. So we would expect this 
equilibrium point to be unstable. 


Solution to Exercise 28 


(a) 


As in the solution to Exercise 27(a), to find the equilibrium points we 
need to find the solutions of 


y = 0, 
—w’ sina — ey = 0. 


Substituting y = 0 from the first equation into the second equation 
leads to x = 0 or x =m. So there are two equilibrium points in the 
range —7 < x < 7, namely (0,0) and (7,0). 


Using reasoning similar to that used in the solution to Exercise 27(b), 
the equilibrium point (0,0) corresponds to a pendulum hanging 
vertically downwards at rest. We expect this equilibrium point to be 
stable. The equilibrium point (7,0) corresponds to a stationary 
pendulum pointing vertically upwards. As in Exercise 27, we expect 
this equilibrium point to be unstable. 


Solution to Exercise 29 


(a) 


Using the usual notation, 


u(x,y) = y, 
v(x, y) = —w* singe. 


So the Jacobian matrix is 


Ou Ou 

i Ox Oy -| 0 4 
Ov Ov —wcosxz 0° 
Ox Oy 


(b) Using Procedure 2, in the neighbourhood of the equilibrium point 
(0,0), the linear system of differential equations that approximates the 
non-linear system is 


The characteristic equation of the Jacobian matrix is 


Vv +07 =0, 


so the eigenvalues are \ = +iw. 


Hence the equilibrium point (0,0) is a stable centre of the linearised 
system. 


The linearised system of differential equations in the neighbourhood of 
the equilibrium point (7,0) is 


A-(% Jp]. 


The eigenvalues of the Jacobian matrix are \ = +w. 


The eigenvalues have opposite signs, so the equilibrium point (7, 0) is 
a saddle of the linearised system. 


Solution to Exercise 30 


The equations of motion are = y, y = —w? sin z, and we have 
OE 2 gi OE 
— =u sinz, —= 
Ox "Oy - 


so equation (23) gives 
a 
— = — t+ — y=e% sinré 
dt Ox Oy : ue 
= w*(sinz)y — yw” sinx = 0. 
So E(t) = E(ax(t), y(t)) is indeed a constant of motion. 
Solution to Exercise 31 
(a) Using the usual notation, 
u(x, y) = ¥, 
v(x, y) = —w* sing — ey. 


So the Jacobian matrix is 
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(b) The linear system of differential equations that approximates the 
system near the equilibrium point (0,0) is 


p|} __| 0 1| |p 
> Le fe 
The characteristic equation of the Jacobian matrix is 
—\(-8 =A) $e7 = +e 407 =0. 
For 0 < € < 2w, the eigenvalues are 
d= E(-e + iv/4u? — €?), 


so the equilibrium point is a spiral sink (which is stable). 


For € > 2w, the eigenvalues are 


A= $(-e ryYV e2 — dw). 


Both the eigenvalues are negative, so (0,0) is a sink (which is stable). 


The linearised system of differential equations in the neighbourhood of 
the equilibrium point (7,0) is 


p) __|0 1] |p 
i=l -J {i 
The characteristic equation of the Jacobian matrix is 
Wao aurea) ek a Su, 
so the eigenvalues are 
ee ee eer 


One of these eigenvalues is positive, whereas the other is negative, so 
the equilibrium point (7,0) is a saddle (which is unstable). 


Solution to Exercise 32 


At A, y =@> 0 so the pendulum is moving in an anticlockwise direction 
and it is approaching its highest point (2 = 7). It slows down as it passes 
through this point, and continues to slow down until a little after the 
highest point at B. It then continues to move in an anticlockwise 
direction, and speeds up until it reaches C’. It moves through its lowest 
position (« = 27), still moving anticlockwise, and heads towards its 
highest point again — but does not reach it. At D it stops, then falls back 
and oscillates about its lowest point with ever-decreasing amplitude. 
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